00000001:02000400:2.0F:1787781716.351702:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787781734.544156:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787781736.246779:0:3240:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 851 MB/s 00000001:01000000:0.0F:1787781736.500660:0:3240:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 748 MB/s 00000001:01000000:0.0:1787781736.749943:0:3240:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4415 MB/s 00000020:02000000:2.0:1787781737.740691:0:3272:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_56_gf34a808 00000400:02000000:0.0:1787781738.766014:0:3287:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.156@tcp [8/256/0/180] 00008000:02000000:2.0:1787781742.056097:0:3437:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787781788.750057:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787781796.975072:0:5813:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787781796.975078:0:5813:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787781796.975193:0:5813:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bf732d96 00000080:02000400:1.0:1787781796.975203:0:5813:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787781796.979640:0:5813:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787781796.979653:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787781796.979692:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002732c598) 00000020:00000080:1.0:1787781796.979778:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787781797.000203:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787781797.000637:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787781797.035470:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787781797.035513:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787781797.035533:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787781797.035585:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787781797.035610:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787781797.036602:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787781797.036612:0:5813:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787781797.036622:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90453cb8 00000020:01000004:2.0:1787781797.036630:0:5813:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787781797.036634:0:5813:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787781797.036639:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bf732d96 from MGS 00000020:01000004:2.0:1787781797.036643:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787781797.036669:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ca61469f) 00000020:00000080:2.0:1787781797.036680:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787781797.037515:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bf732d96 from MGS, refs=2 00080000:01000000:2.0:1787781797.037523:0:5813:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787781797.037532:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90453cc6 00000100:00100000:2.0:1787781797.037648:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787781797.040068:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787781797.040079:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787781797.043721:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787781797.043733:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787781797.044587:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787781797.044765:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787781797.044769:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787781797.045569:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787781797.045576:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787781797.045973:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787781797.045979:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787781797.046567:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781797.046570:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781797.046572:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781797.053603:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781797.053610:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781797.053612:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781797.060943:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787781797.062326:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787781797.310446:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2559 MB/s 00000001:01000000:2.0:1787781797.559898:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3255 MB/s 00000001:01000000:2.0:1787781797.809957:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 783 MB/s 00000001:01000000:2.0:1787781798.060169:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 775 MB/s 00080000:10000000:3.0:1787781798.074748:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787781798.079923:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787781798.089527:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787781798.089545:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787781798.089548:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787781798.090892:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787781798.090981:0:5813:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787781798.091021:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787781798.091223:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787781798.091250:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787781798.091504:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787781798.091634:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787781798.091640:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787781798.093016:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787781798.093026:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787781798.094930:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787781798.094943:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787781798.097044:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787781798.097066:0:5813:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.156@tcp' 00000020:01000004:3.0:1787781798.097068:0:5813:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:1.0:1787781798.097845:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1787781798.098056:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.156@tcp (typ=mgc) 00000020:00000080:1.0:1787781798.098068:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.156@tcp (0000000093dcbf12) 00000020:00000080:1.0:1787781798.098086:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787781798.098178:0:5813:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000035cc10b9@MGC192.168.202.156@tcp: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1787781798.098310:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.156@tcp-0 is initialized 00000040:01000000:1.0:1787781798.098316:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787781798.100536:0:5830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787781798.100591:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.156@tcp (uuid 9f3bcc54-cf30-454f-ba67-121e6963b1be) 00000020:00000080:3.0:1787781798.100614:0:5813:0:(genops.c:1385:class_connect()) connect: client 9f3bcc54-cf30-454f-ba67-121e6963b1be, cookie 0x3ad9816c90453cd4 00000100:00080000:3.0:1787781798.100626:0:5813:0:(import.c:510:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787781798.100631:0:5813:0:(import.c:624:import_select_connection()) MGC192.168.202.156@tcp: import 0000000035cc10b9 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1787781798.100666:0:5813:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000254e2756 x1874625023705216/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787781798.101002:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000254e2756 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9f3bcc54-cf30-454f-ba67-121e6963b1be:3302:1874625023705216:0@lo:250: 00000100:00100000:1.0:1787781798.101084:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781798.101175:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023705216 00000100:00100000:3.0:1787781798.101182:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023705216 00000100:00100000:3.0:1787781798.101221:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787781798.101227:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7eb682d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1874625023705216:12345-0@lo:250: 00010000:00080000:3.0:1787781798.101248:0:5825:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9f3bcc54-cf30-454f-ba67-121e6963b1be@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:3.0:1787781798.101271:0:5825:0:(genops.c:1385:class_connect()) connect: client 9f3bcc54-cf30-454f-ba67-121e6963b1be, cookie 0x3ad9816c90453cdb 00000100:00080000:3.0:1787781798.101392:0:5825:0:(import.c:65:import_set_state_nolock()) 00000000e4161ad8 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787781798.102362:0:5813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS 00000020:01000004:2.0:1787781798.102389:0:5813:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787781798.102395:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787781798.102409:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000004d310cf8) 00000020:00000080:2.0:1787781798.102430:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787781798.105060:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7eb682d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:3302:x1874625023705216:12345-0@lo:250: Request processed in 3821us (3967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781798.105077:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787781798.105258:0:3302:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787781798.105270:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.156@tcp: connect to target with instance 0 00000100:00080000:1.0:1787781798.105278:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787781798.105282:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787781798.105287:0:3302:0:(import.c:65:import_set_state_nolock()) 0000000035cc10b9 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787781798.105290:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787781798.105344:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787781798.105351:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000254e2756 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9f3bcc54-cf30-454f-ba67-121e6963b1be:3302:1874625023705216:0@lo:250: 00000100:00100000:3.0:1787781798.125685:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787781798.125942:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787781798.125950:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787781798.131629:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787781798.131646:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787781798.132149:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787781798.132156:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787781798.136199:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787781798.136396:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787781798.136402:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787781798.144481:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787781798.144504:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787781798.192611:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781798.192890:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787781798.192897:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787781798.194293:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787781798.194302:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787781798.194934:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781798.195163:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787781798.195169:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787781798.195693:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787781798.195699:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787781798.196408:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781798.196549:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787781798.196561:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787781798.197150:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787781798.197156:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787781798.197762:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781798.198191:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787781798.198196:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787781798.198634:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787781798.198640:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787781798.221330:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787781798.221550:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787781798.221556:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787781798.226266:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787781798.226282:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787781798.232071:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787781798.232094:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787781798.238366:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787781798.238399:0:5813:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787781798.238406:0:5813:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787781798.238538:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787781798.238578:0:5813:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787781798.238583:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787781798.238585:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787781798.238586:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781798.238587:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781798.238588:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781798.238590:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781798.238591:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787781798.238592:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787781798.238594:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781798.238595:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781798.238596:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781798.238598:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787781798.238600:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787781798.238602:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787781798.238603:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787781798.238604:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781798.238605:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781798.238606:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781798.238607:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781798.238608:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787781798.238609:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787781798.238610:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781798.238611:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781798.238612:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781798.238625:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787781798.238653:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787781798.238671:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000956ad574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705344:0@lo:253: 00000100:00100000:2.0:1787781798.238784:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781798.238998:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070c42caa going to sleep for 11 seconds 00000100:00100000:0.0:1787781798.239510:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023705344 00000100:00100000:0.0:1787781798.239518:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023705344 00000100:00100000:0.0:1787781798.239725:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787781798.239736:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a03c858a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:5813:x1874625023705344:12345-0@lo:253: 20000000:01000000:0.0:1787781798.239782:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787781798.239785:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787781798.240177:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787781798.240240:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787781798.240511:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781798.241565:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787781798.241955:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787781798.241958:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787781798.241964:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787781798.241967:0:5827:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787781798.241978:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787781798.242149:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781798.242385:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787781798.242398:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787781798.242443:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787781798.242488:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787781798.242539:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787781798.242885:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787781798.242895:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787781798.242943:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787781798.242952:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787781798.242985:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787781798.242993:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787781798.243025:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787781798.243074:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787781798.243106:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787781798.243112:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787781798.243124:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781798.243334:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787781798.243345:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787781798.243379:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787781798.243414:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787781798.243477:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787781798.243490:0:5827:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787781798.243558:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787781798.243567:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787781798.243639:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787781798.243676:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787781798.244881:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787781798.244905:0:5827:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787781798.245035:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787781798.245046:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787781798.245078:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787781798.245134:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787781798.245304:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787781798.245349:0:5827:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787781798.245357:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787781798.246200:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787781798.246508:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787781798.246533:0:5827:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.156@tcp for mdt 20000000:01000000:3.0:1787781798.246535:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:3.0:1787781798.246569:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787781798.246576:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787781798.246953:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787781798.246963:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:3.0:1787781798.247016:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787781798.247026:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787781798.247059:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787781798.247095:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787781798.247161:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787781798.247165:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787781798.247169:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787781798.247179:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787781798.247182:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787781798.247210:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787781798.247212:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787781798.247560:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787781798.251337:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787781798.251395:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787781798.251428:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787781798.251443:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787781798.251445:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787781798.254950:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787781798.255338:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787781798.255386:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787781798.255458:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1787781798.255477:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787781798.255480:0:5827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787781798.255485:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787781798.255487:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787781798.255493:0:5827:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787781798.255499:0:5827:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787781798.257200:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787781798.257410:0:5827:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787781798.262389:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787781798.262423:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787781798.262467:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787781798.262493:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787781798.262508:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262521:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262527:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262531:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262534:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262538:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262541:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be4bd9f0 already unused, calling callback (000000005cee74a7) 00010000:00010000:1.0:1787781798.262544:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262548:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262556:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262560:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.262563:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000be4bd9f0/0x3ad9816c90453ce9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787781798.262578:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787781798.453483:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a03c858a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:5813:x1874625023705344:12345-0@lo:253: Request processed in 213743us (214694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781798.453499:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781798.453818:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000956ad574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705344:0@lo:253: 10000000:01000000:1.0:1787781798.453835:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787781798.453839:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787781798.453840:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787781798.453842:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787781798.453843:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787781798.453844:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787781798.453845:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787781798.453856:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787781798.453858:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787781798.453859:0:5813:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787781798.453861:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787781798.453862:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787781798.453886:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bf732d96 from lustre-MDT0000 10000000:01000000:1.0:1787781798.453913:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787781798.453916:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787781798.453921:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ef450c2b370 10000000:01000000:1.0:1787781798.453925:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787781798.453932:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef450c2b370 from 1 10000000:01000000:1.0:1787781798.453934:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787781798.453968:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.453978:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.453987:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.454004:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705472:0@lo:101: 00000100:00100000:1.0:1787781798.454055:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.454153:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd2d788a going to sleep for 11 seconds 00000100:00100000:3.0:1787781798.454217:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023705472 00000100:00100000:3.0:1787781798.454224:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023705472 00000100:00100000:3.0:1787781798.454483:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787781798.454493:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb38e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:5813:x1874625023705472:12345-0@lo:101: 00010000:00010000:3.0:1787781798.454507:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781798.454527:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453cf0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781798.454551:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453cf0 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781798.454560:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453cf0 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781798.454569:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3d2135c, rc 0) 00000100:00100000:1.0:1787781798.454725:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705472:0@lo:101: 00010000:00010000:1.0:1787781798.454737:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.454746:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.454839:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705600:0@lo:501: 00000100:00100000:1.0:1787781798.455031:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781798.455151:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb38e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+6:5813:x1874625023705472:12345-0@lo:101: Request processed in 659us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781798.455159:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787781798.455220:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd2d788a going to sleep for 11 seconds 00000100:00100000:2.0:1787781798.455289:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023705600 00000100:00100000:2.0:1787781798.455294:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023705600 00000100:00100000:2.0:1787781798.455317:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787781798.455323:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009637c9a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+6:5813:x1874625023705600:12345-0@lo:501: 00000100:00100000:2.0:1787781798.455566:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009637c9a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+6:5813:x1874625023705600:12345-0@lo:501: Request processed in 242us (534us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787781798.455573:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787781798.455807:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705600:0@lo:501: 10000000:01000000:1.0:1787781798.455836:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787781798.455860:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.455869:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781798.455878:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef4450df800 10000000:01000000:1.0:1787781798.455883:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787781798.455887:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ef4450df800 10000000:01000000:1.0:1787781798.455889:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787781798.455892:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ef4450df800 from 1 10000000:01000000:1.0:1787781798.455894:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787781798.455913:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000c8034de2/0x3ad9816c90453cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.455933:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000c8034de2/0x3ad9816c90453cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.455941:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000c8034de2/0x3ad9816c90453cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.455953:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705728:0@lo:101: 00000100:00100000:1.0:1787781798.455980:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.455995:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd2d788a going to sleep for 11 seconds 00000100:00100000:2.0:1787781798.456063:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023705728 00000100:00100000:2.0:1787781798.456067:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023705728 00000100:00100000:2.0:1787781798.456084:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787781798.456089:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e25dbdec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+6:5813:x1874625023705728:12345-0@lo:101: 00010000:00010000:2.0:1787781798.456096:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781798.456107:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000064e0394a/0x3ad9816c90453d05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453cfe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.456121:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064e0394a/0x3ad9816c90453d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453cfe expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.456129:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000064e0394a/0x3ad9816c90453d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453cfe expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.456136:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000064e0394a, rc 0) 00000100:00100000:2.0:1787781798.456172:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e25dbdec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+7:5813:x1874625023705728:12345-0@lo:101: Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781798.456179:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787781798.456249:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705728:0@lo:101: 00010000:00010000:1.0:1787781798.456260:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000c8034de2/0x3ad9816c90453cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.456267:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000c8034de2/0x3ad9816c90453cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781798.456278:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787781798.456280:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000c8034de2/0x3ad9816c90453cfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.456286:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000c8034de2/0x3ad9816c90453cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781798.456291:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787781798.456294:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787781798.456298:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ef4450df800 10000000:01000000:1.0:1787781798.456300:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787781798.456303:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787781798.456309:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787781798.456322:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.456328:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.456334:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.456345:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705856:0@lo:101: 00000100:00100000:1.0:1787781798.456368:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.456387:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd2d788a going to sleep for 11 seconds 00000100:00100000:2.0:1787781798.456436:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023705856 00000100:00100000:2.0:1787781798.456440:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023705856 00000100:00100000:2.0:1787781798.456456:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787781798.456460:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005050eaa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+7:5813:x1874625023705856:12345-0@lo:101: 00010000:00010000:2.0:1787781798.456472:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781798.456480:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453d0c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.456492:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453d0c expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.456500:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453d0c expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.456506:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000033a79fec, rc 0) 00000100:00100000:2.0:1787781798.456542:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005050eaa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+8:5813:x1874625023705856:12345-0@lo:101: Request processed in 81us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781798.456548:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787781798.456632:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705856:0@lo:101: 00010000:00010000:1.0:1787781798.456641:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.456648:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.456686:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705984:0@lo:501: 00000100:00100000:1.0:1787781798.456905:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.456920:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd2d788a going to sleep for 11 seconds 00000100:00100000:2.0:1787781798.456966:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023705984 00000100:00100000:2.0:1787781798.456970:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023705984 00000100:00100000:2.0:1787781798.456987:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787781798.456992:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3dc439 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+8:5813:x1874625023705984:12345-0@lo:501: 00000100:00100000:2.0:1787781798.457212:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3dc439 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:5813:x1874625023705984:12345-0@lo:501: Request processed in 219us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781798.457219:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787781798.457390:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023705984:0@lo:501: 00000100:00100000:1.0:1787781798.457419:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706112:0@lo:503: 00000100:00100000:1.0:1787781798.457454:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.457509:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd2d788a going to sleep for 11 seconds 00000100:00100000:2.0:1787781798.457545:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023706112 00000100:00100000:2.0:1787781798.457548:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023706112 00000100:00100000:2.0:1787781798.457777:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787781798.457784:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e1a1fa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:5813:x1874625023706112:12345-0@lo:503: 00000100:00100000:2.0:1787781798.457973:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e1a1fa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:5813:x1874625023706112:12345-0@lo:503: Request processed in 189us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781798.457980:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787781798.458054:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706112:0@lo:503: 00000100:00100000:1.0:1787781798.458397:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:5856:1874625023706240:0@lo:502: 00000100:00100000:1.0:1787781798.458433:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.458534:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000956524b8 going to sleep for 11 seconds 00000100:00100000:3.0:1787781798.458761:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023706240 00000100:00100000:3.0:1787781798.458766:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023706240 00000100:00100000:3.0:1787781798.458802:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781798.458808:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008720478c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:5856:x1874625023706240:12345-0@lo:502: 00000100:00100000:3.0:1787781798.458992:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008720478c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:5856:x1874625023706240:12345-0@lo:502: Request processed in 183us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781798.458999:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787781798.459088:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:5856:1874625023706240:0@lo:502: 00000020:01000000:1.0:1787781798.459110:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781798.459120:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781798.459123:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787781798.459128:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787781798.459131:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787781798.459143:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d84f0796) 00000020:00000080:1.0:1787781798.459159:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787781798.459163:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787781798.459224:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787781798.459229:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90453d21 00000020:00000080:1.0:1787781798.459423:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787781798.459427:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781798.459430:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781798.459431:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787781798.459434:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781798.459437:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781798.459438:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787781798.459441:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787781798.459447:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d1d7c189) 00000020:00000080:1.0:1787781798.459456:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787781798.459459:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787781798.459461:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787781798.459463:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787781798.459468:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787781798.459516:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bf732d96 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787781798.459535:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000db60ffba) 00000020:00000080:1.0:1787781798.459542:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787781798.459604:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787781798.459609:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c90453d36 00000020:00000080:1.0:1787781798.459912:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787781798.459918:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787781798.459922:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3ad9816c90453d3d 00080000:01000000:1.0:1787781798.459927:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787781798.459930:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90453d44 00080000:10000000:1.0:1787781798.460272:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787781798.460464:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787781798.464905:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787781798.526249:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787781798.526542:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787781798.533192:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787781798.533761:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787781798.556768:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000062ae7bc6) 00000020:00000080:3.0:1787781798.556817:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787781798.557604:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787781798.557616:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90453d52 00000020:00000080:2.0:1787781798.563031:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787781798.565612:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787781798.599703:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787781798.621377:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787781798.652989:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787781798.696733:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787781798.742310:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787781798.788564:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3ad9816c90453d59 00000020:00000080:2.0:1787781798.788996:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787781798.789008:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781798.789014:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781798.789017:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787781798.789020:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781798.789023:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781798.789025:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787781798.789028:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787781798.789029:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787781798.789031:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781798.789033:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781798.789034:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787781798.789036:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781798.789040:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781798.789041:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787781798.789045:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787781798.789081:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787781798.789135:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000240d052 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:5856:1874625023706368:0@lo:502: 00000100:00100000:2.0:1787781798.789310:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781798.789413:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000caba3e0d going to sleep for 11 seconds 00000100:00100000:3.0:1787781798.789521:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023706368 00000100:00100000:3.0:1787781798.789529:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023706368 00000100:00100000:3.0:1787781798.789622:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787781798.789630:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6d14f50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:5856:x1874625023706368:12345-0@lo:502: 00000100:00100000:3.0:1787781798.790152:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6d14f50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:5856:x1874625023706368:12345-0@lo:502: Request processed in 522us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781798.790162:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781798.790386:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000240d052 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:5856:1874625023706368:0@lo:502: 00000020:01000000:0.0:1787781798.790416:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781798.790421:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781798.790422:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787781798.790426:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787781798.790584:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787781798.790606:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787781798.790631:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.790642:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781798.790650:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef4450df800 from 1 10000000:01000000:1.0:1787781798.790653:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787781798.790684:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.790854:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.790864:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.790882:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706496:0@lo:101: 00000100:00100000:1.0:1787781798.790921:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.790960:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087390e9c going to sleep for 11 seconds 00000100:00100000:0.0:1787781798.791043:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023706496 00000100:00100000:0.0:1787781798.791048:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023706496 00000100:00100000:0.0:1787781798.791083:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781798.791090:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a703d486 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:5813:x1874625023706496:12345-0@lo:101: 00010000:00010000:0.0:1787781798.791100:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781798.791115:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453d60 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.791133:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453d60 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.791142:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453d60 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.791149:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb13e641, rc 0) 00000100:00100000:0.0:1787781798.791193:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a703d486 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:5813:x1874625023706496:12345-0@lo:101: Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781798.791199:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787781798.791434:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706496:0@lo:101: 00010000:00010000:1.0:1787781798.791447:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.791456:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.792110:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706624:0@lo:256: 00000100:00100000:1.0:1787781798.792153:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.792238:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087390e9c going to sleep for 11 seconds 00000100:00100000:3.0:1787781798.792427:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023706624 00000100:00100000:3.0:1787781798.792432:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023706624 00000100:00100000:3.0:1787781798.792468:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787781798.792475:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000486113b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:5813:x1874625023706624:12345-0@lo:256: 20000000:01000000:3.0:1787781798.792491:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787781798.792496:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787781798.792557:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000486113b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:5813:x1874625023706624:12345-0@lo:256: Request processed in 84us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781798.792564:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787781798.792665:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706624:0@lo:256: 10000000:01000000:1.0:1787781798.793485:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787781798.793550:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.793561:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781798.793569:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef4450df800 from 1 10000000:01000000:1.0:1787781798.793572:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787781798.793598:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.793605:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.793612:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.793639:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706752:0@lo:101: 00000100:00100000:1.0:1787781798.793676:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.793718:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087390e9c going to sleep for 11 seconds 00000100:00100000:0.0:1787781798.793783:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023706752 00000100:00100000:0.0:1787781798.793816:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023706752 00000100:00100000:0.0:1787781798.793856:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781798.793864:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7677a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:5813:x1874625023706752:12345-0@lo:101: 00010000:00010000:0.0:1787781798.793873:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781798.793886:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453d6e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.793905:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453d6e expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.793914:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453d6e expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.793922:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007f8153b7, rc 0) 00000100:00100000:0.0:1787781798.793954:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7677a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:5813:x1874625023706752:12345-0@lo:101: Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781798.793960:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787781798.794099:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706752:0@lo:101: 00010000:00010000:1.0:1787781798.794111:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.794119:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.794163:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706880:0@lo:501: 00000100:00100000:1.0:1787781798.794185:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781798.794350:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023706880 00000100:00100000:0.0:1787781798.794355:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023706880 00000100:00100000:0.0:1787781798.794378:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787781798.794383:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067dc53eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:5813:x1874625023706880:12345-0@lo:501: 00000100:00100000:0.0:1787781798.794907:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067dc53eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:5813:x1874625023706880:12345-0@lo:501: Request processed in 522us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781798.794914:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781798.795066:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087390e9c going to sleep for 11 seconds 00000100:00100000:1.0:1787781798.795080:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023706880:0@lo:501: 00000100:00100000:1.0:1787781798.795108:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707008:0@lo:503: 00000100:00100000:1.0:1787781798.795143:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.795157:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087390e9c going to sleep for 11 seconds 00000100:00100000:1.0:1787781798.795175:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023707008 00000100:00100000:1.0:1787781798.795179:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023707008 00000100:00100000:1.0:1787781798.795197:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781798.795202:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b8c4f34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:5813:x1874625023707008:12345-0@lo:503: 00000040:00080000:1.0:1787781798.795246:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787781798.795284:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b8c4f34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:5813:x1874625023707008:12345-0@lo:503: Request processed in 82us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781798.795290:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781798.795327:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707008:0@lo:503: 00000040:00080000:0.0:1787781798.801366:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787781798.802978:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787781798.803006:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787781798.803019:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.803032:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781798.803103:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787781798.803106:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef4450df800 10000000:01000000:2.0:1787781798.803109:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef4450df800 10000000:01000000:2.0:1787781798.803113:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787781798.803119:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef4450df800 from 1 10000000:01000000:2.0:1787781798.803122:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781798.803157:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.803165:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.803176:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781798.803198:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000352ca05e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707136:0@lo:101: 00000100:00100000:2.0:1787781798.803274:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781798.803486:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000003969609d going to sleep for 11 seconds 00000100:00100000:0.0:1787781798.803940:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023707136 00000100:00100000:0.0:1787781798.803948:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023707136 00000100:00100000:0.0:1787781798.803993:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781798.804010:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026123e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:5813:x1874625023707136:12345-0@lo:101: 00010000:00010000:0.0:1787781798.804024:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781798.804036:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453d7c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.804057:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453d7c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.804066:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453d7c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.804073:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001aa6227d, rc 0) 00000100:00100000:0.0:1787781798.804117:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026123e89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5813:x1874625023707136:12345-0@lo:101: Request processed in 109us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781798.804123:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787781798.804251:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000352ca05e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707136:0@lo:101: 00010000:00010000:1.0:1787781798.804266:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.804274:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.804327:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707264:0@lo:501: 00000100:00100000:1.0:1787781798.804354:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.804382:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087390e9c going to sleep for 11 seconds 00000100:00100000:0.0:1787781798.804458:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023707264 00000100:00100000:0.0:1787781798.804463:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023707264 00000100:00100000:0.0:1787781798.804491:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787781798.804497:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e2ba6ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5813:x1874625023707264:12345-0@lo:501: 00000100:00100000:0.0:1787781798.804894:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e2ba6ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5813:x1874625023707264:12345-0@lo:501: Request processed in 396us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781798.804901:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787781798.808091:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3758cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707264:0@lo:501: 00000100:00100000:2.0:1787781798.808153:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf9fe86a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707392:0@lo:503: 00000100:00100000:2.0:1787781798.808266:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781798.808336:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e5a8138c going to sleep for 11 seconds 00000100:00100000:3.0:1787781798.811933:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023707392 00000100:00100000:3.0:1787781798.811950:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023707392 00000100:00100000:3.0:1787781798.812035:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787781798.812044:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000deaec04e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5813:x1874625023707392:12345-0@lo:503: 00000100:00100000:3.0:1787781798.812456:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000deaec04e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5813:x1874625023707392:12345-0@lo:503: Request processed in 413us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781798.812465:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787781798.812604:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf9fe86a pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707392:0@lo:503: 00000100:00100000:2.0:1787781798.814140:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf9fe86a pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:5861:1874625023707520:0@lo:502: 00000100:00100000:2.0:1787781798.814224:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781798.814894:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000831d141c going to sleep for 11 seconds 00000100:00100000:1.0:1787781798.815026:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023707520 00000100:00100000:1.0:1787781798.815035:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023707520 00000100:00100000:1.0:1787781798.815075:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787781798.815082:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000993f0e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5861:x1874625023707520:12345-0@lo:502: 00000100:00100000:1.0:1787781798.817594:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000993f0e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5861:x1874625023707520:12345-0@lo:502: Request processed in 2506us (3367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781798.817609:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787781798.817878:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf9fe86a pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:5861:1874625023707520:0@lo:502: 00000020:01000004:2.0:1787781798.817949:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787781798.817963:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c251f641) 00000020:00000080:2.0:1787781798.817983:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787781798.818067:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bf732d96 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787781798.818071:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bf732d96 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787781798.818073:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bf732d96 4 00010000:00080000:2.0:1787781798.818102:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006553c667@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1787781798.819710:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787781798.819952:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787781798.819985:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787781798.819997:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3ad9816c90453d91 00000100:00080000:2.0:1787781798.820006:0:5861:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787781798.820011:0:5861:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006553c667 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1787781798.820046:0:5861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bf9fe86a x1874625023707648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787781798.820067:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787781798.820822:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf9fe86a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023707648:0@lo:38: 00000100:00100000:1.0:1787781798.820920:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781798.823465:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023707648 00000100:00100000:2.0:1787781798.823479:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023707648 00000100:00100000:2.0:1787781798.823519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781798.823525:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d40b821d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874625023707648:12345-0@lo:38: 00000100:00100000:2.0:1787781798.823611:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d40b821d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874625023707648:12345-0@lo:38: Request processed in 86us (2692us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787781798.823618:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787781798.825048:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d35bd98 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:5861:1874625023707776:0@lo:502: 00000100:00100000:3.0:1787781798.825115:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781798.825140:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047722aae going to sleep for 11 seconds 00000100:00100000:1.0:1787781798.825503:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787781798.825510:0:3302:0:(import.c:65:import_set_state_nolock()) 000000006553c667 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787781798.825515:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787781798.825518:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf9fe86a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023707648:0@lo:38: 00000100:00100000:1.0:1787781798.825546:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023707776 00000100:00100000:1.0:1787781798.825550:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023707776 00000100:00100000:1.0:1787781798.825630:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787781798.825638:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8dcef0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5861:x1874625023707776:12345-0@lo:502: 00000100:00100000:1.0:1787781798.825886:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8dcef0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5861:x1874625023707776:12345-0@lo:502: Request processed in 249us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781798.825893:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787781798.825972:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d35bd98 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:5861:1874625023707776:0@lo:502: 00000040:00080000:2.0:1787781798.825996:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787781798.830871:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787781798.830907:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787781798.830928:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.830941:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787781798.831003:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787781798.831007:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787781798.831008:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787781798.831009:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787781798.831011:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787781798.831012:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787781798.831013:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787781798.831014:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787781798.831016:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787781798.831017:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787781798.831018:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787781798.831019:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787781798.831022:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787781798.831025:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787781798.831026:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787781798.831027:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787781798.831028:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787781798.831029:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787781798.831030:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787781798.831031:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787781798.831032:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787781798.831032:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787781798.831033:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787781798.831034:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787781798.831035:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787781798.831061:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787781798.831077:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9bf0410 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707904:0@lo:253: 00000100:00100000:0.0:1787781798.831140:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781798.832963:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0757f82 going to sleep for 11 seconds 00000100:00100000:3.0:1787781798.833074:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023707904 00000100:00100000:3.0:1787781798.833083:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023707904 00000100:00100000:3.0:1787781798.833125:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787781798.833132:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a4f6b6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5813:x1874625023707904:12345-0@lo:253: 20000000:01000000:3.0:1787781798.833173:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787781798.833186:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787781798.890197:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787781798.890411:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787781798.890512:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787781798.890518:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787781798.890536:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.890553:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453d60 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.890566:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.890605:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453d60 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.890615:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453d60 expref: 12 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781798.890626:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b49cc6f2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874625023708032:0@lo:104: 00000100:00100000:0.0:1787781798.890677:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781798.891158:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023330054 going to sleep for 11 seconds 00000100:00100000:2.0:1787781798.891318:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023708032 00000100:00100000:2.0:1787781798.891324:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023708032 00000100:00100000:2.0:1787781798.891363:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781798.891371:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b03579ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5849:x1874625023708032:12345-0@lo:104: 00010000:00010000:2.0:1787781798.891383:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781798.891436:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787781798.891441:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b03579ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5849:x1874625023708032:12345-0@lo:104: Request processed in 72us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781798.891448:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787781798.891459:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781798.891464:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891471:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000097699518 already unused, calling callback (00000000f0f42387) 10000000:00010000:1.0:1787781798.891475:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891482:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781798.891488:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781798.891494:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787781798.891514:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b49cc6f2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874625023708032:0@lo:104: 00010000:00010000:1.0:1787781798.891525:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891531:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781798.891531:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891547:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891553:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 0000000097699518/0x3ad9816c90453d60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d67 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891580:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781798.891581:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781798.891583:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781798.891620:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023708160:0@lo:103: 00000100:00100000:1.0:1787781798.891647:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781798.891677:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023708160 00000100:00100000:1.0:1787781798.891681:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023708160 00010000:00010000:1.0:1787781798.891696:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453d60 expref: 13 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.891724:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787781798.891730:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe58852 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:3304:x1874625023708160:12345-0@lo:103: 00010000:00010000:1.0:1787781798.891740:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781798.891744:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453d60 expref: 13 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891752:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453d60 expref: 13 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891764:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb13e641/0x3ad9816c90453d67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453d60 expref: 13 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891776:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891782:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787781798.891825:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001308168s 00010000:00010000:1.0:1787781798.891832:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891838:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891857:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891863:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891867:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3220bd9 already unused, calling callback (000000005cee74a7) 00010000:00010000:1.0:1787781798.891870:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891876:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891892:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781798.891903:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781798.891905:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.891911:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781798.891917:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3220bd9/0x3ad9816c90453d98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781798.891936:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe58852 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:3304:x1874625023708160:12345-0@lo:103: Request processed in 206us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781798.891942:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781798.891970:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023708160:0@lo:103: 00000100:00100000:2.0:1787781798.907676:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a4f6b6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:5813:x1874625023707904:12345-0@lo:253: Request processed in 74537us (76528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781798.907751:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781798.907928:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9bf0410 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:5813:1874625023707904:0@lo:253: 10000000:01000000:0.0:1787781798.907944:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787781798.907947:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787781798.907960:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787781798.907962:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787781798.907963:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787781798.907964:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787781798.907965:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787781798.907967:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787781798.907968:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787781798.907969:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787781798.907971:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787781798.907972:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787781798.907973:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787781798.907985:0:5813:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787781798.914179:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787781798.922888:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787781798.923171:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787781798.923565:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787781798.924470:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787781798.924817:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787781798.925482:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787781798.925920:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787781798.926109:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787781798.926286:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787781798.926494:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787781798.926834:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787781798.973329:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787781799.019964:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787781799.020175:0:5866:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787781799.020180:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787781799.020376:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787781799.027564:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787781799.029323:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787781799.032067:0:5813:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787781799.032088:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787781799.032608:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781799.035604:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787781799.036187:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787781799.036216:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787781799.036424:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787781799.036606:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787781799.043040:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787781799.045330:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787781799.045504:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787781799.045636:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787781799.047574:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787781799.047891:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787781799.048045:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787781799.048232:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787781799.048371:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787781799.048518:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787781799.053308:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787781799.053516:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787781799.053659:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787781799.053830:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787781799.053980:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787781799.054135:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787781799.054414:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787781799.054543:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787781799.054622:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787781799.054750:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787781799.054968:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787781799.057580:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787781799.057864:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787781799.058009:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787781799.058191:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787781799.058324:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787781799.058476:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787781799.058604:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787781799.058765:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787781799.058938:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787781799.059093:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787781799.059219:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787781799.059416:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787781799.077652:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1787781799.103363:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787781799.136943:0:5813:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787781799.136977:0:5813:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf7fc1cb3988 00100000:10000000:1.0:1787781799.136985:0:5813:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:0.0:1787781799.138597:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787781799.138697:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787781799.138701:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:2.0:1787781799.139766:0:5813:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787781799.139781:0:5813:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787781799.139941:0:5813:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787781799.139967:0:5813:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787781800.131936:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781801.149977:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781802.174055:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787781802.513708:0:6109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787781803.200813:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787781804.225147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787781804.225159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787781804.225161:0:36:0:(import.c:65:import_set_state_nolock()) 000000006553c667 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787781804.225174:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006553c667 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1787781804.225203:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000030c0e586 x1874625023708416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787781804.225233:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000030c0e586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023708416:0@lo:38: 00000100:00100000:0.0:1787781804.225236:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa49f3da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023708288:0@lo:400: 00010000:00010000:1.0:1787781804.225336:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781804.228503:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781804.228665:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023708416 00000100:00100000:1.0:1787781804.228674:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023708416 00000100:00100000:1.0:1787781804.228869:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781804.228876:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087b0ec63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874625023708416:12345-0@lo:38: 00010000:00080000:1.0:1787781804.228906:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1787781804.228940:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3ad9816c90453d9f 00000004:00100000:1.0:1787781804.228984:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787781804.229109:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000a6d2a73e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787781804.229176:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087b0ec63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874625023708416:12345-0@lo:38: Request processed in 298us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781804.229184:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787781804.229220:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000030c0e586 x1874625023708416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787781814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787781804.229238:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787781804.229246:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787781804.229251:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787781804.229254:0:3302:0:(import.c:65:import_set_state_nolock()) 000000006553c667 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787781804.229259:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000030c0e586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023708416:0@lo:38: 00000100:00100000:0.0:1787781804.237403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781804.237449:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023708288 00000100:00100000:1.0:1787781804.237459:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023708288 00000100:00100000:1.0:1787781804.237520:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787781804.237528:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fd64bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:3305:x1874625023708288:12345-0@lo:400: 00000100:00100000:1.0:1787781804.237599:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fd64bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:3305:x1874625023708288:12345-0@lo:400: Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781804.237606:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781804.239061:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa49f3da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023708288:0@lo:400: 00010000:00010000:0.0:1787781805.246765:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787781805.761894:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787781805.761901:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef4450df800 from 3 10000000:01000000:2.0:1787781805.761906:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787781805.761953:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 000000002029584c/0x3ad9816c90453da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781805.761966:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 000000002029584c/0x3ad9816c90453da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781805.761976:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 000000002029584c/0x3ad9816c90453da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781805.762000:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028e05fee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023708544:0@lo:101: 00000100:00100000:2.0:1787781805.762070:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781805.762265:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023708544 00000100:00100000:0.0:1787781805.762273:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023708544 00000100:00100000:2.0:1787781805.765231:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055a17e81 going to sleep for 11 seconds 00000100:00100000:0.0:1787781805.767563:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787781805.767580:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023e74331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:5830:x1874625023708544:12345-0@lo:101: 00010000:00010000:0.0:1787781805.767600:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781805.767730:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c3fb7cc8/0x3ad9816c90453dad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453da6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781805.767772:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3fb7cc8/0x3ad9816c90453dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453da6 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781805.767808:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c3fb7cc8/0x3ad9816c90453dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453da6 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781805.767817:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c3fb7cc8, rc 0) 00000100:00100000:0.0:1787781805.767904:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023e74331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023708544:12345-0@lo:101: Request processed in 331us (5835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781805.767911:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787781805.767979:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028e05fee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023708544:0@lo:101: 00010000:00010000:0.0:1787781805.767999:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 000000002029584c/0x3ad9816c90453da6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781805.768008:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 000000002029584c/0x3ad9816c90453da6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781805.768071:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059434a6b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023708672:0@lo:256: 00000100:00100000:0.0:1787781805.768110:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781805.768139:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ae287ec going to sleep for 11 seconds 00000100:00100000:0.0:1787781805.768153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023708672 00000100:00100000:0.0:1787781805.768159:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023708672 00000100:00100000:0.0:1787781805.768185:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787781805.768191:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095368d33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023708672:12345-0@lo:256: 20000000:01000000:0.0:1787781805.768206:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787781805.768222:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787781805.768225:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787781805.769879:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095368d33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023708672:12345-0@lo:256: Request processed in 1685us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781805.769891:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787781805.769945:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059434a6b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023708672:0@lo:256: 10000000:01000000:0.0:1787781805.769991:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787781805.769998:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 000000002029584c/0x3ad9816c90453da6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781805.770008:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 000000002029584c/0x3ad9816c90453da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.269978:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787781806.844040:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8f51ad90 20000000:00000080:0.0:1787781806.844057:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef478136400 uarg=0000000000000000 20000000:01000000:0.0:1787781806.844092:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787781806.844098:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787781806.844103:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787781806.844377:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787781806.844388:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787781806.851543:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781806.855563:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787781806.855662:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787781806.855716:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787781806.855735:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787781806.855753:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781806.855770:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453d6e expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781806.855803:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781806.855848:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453d6e expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781806.855861:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453d6e expref: 11 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781806.855874:0:6311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059434a6b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1874625023708800:0@lo:104: 00000100:00100000:0.0:1787781806.855935:0:6311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781806.856111:0:6311:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ef68bfb going to sleep for 11 seconds 00000100:00100000:2.0:1787781806.856273:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023708800 00000100:00100000:2.0:1787781806.856280:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023708800 00000100:00100000:2.0:1787781806.856323:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787781806.856331:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000220c2324 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:6311:x1874625023708800:12345-0@lo:104: 00010000:00010000:2.0:1787781806.856343:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781806.856418:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787781806.856423:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000220c2324 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:6311:x1874625023708800:12345-0@lo:104: Request processed in 93us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781806.856439:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787781806.856493:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781806.856499:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.856506:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000070c1eb86 already unused, calling callback (00000000f0f42387) 10000000:00010000:1.0:1787781806.856508:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.856519:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781806.856526:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781806.856531:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787781806.856619:0:6311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059434a6b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1874625023708800:0@lo:104: 00010000:00010000:0.0:1787781806.856636:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.856708:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.856715:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781806.856748:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.856755:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 0000000070c1eb86/0x3ad9816c90453d6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781806.856760:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c11649d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023708928:0@lo:103: 00010000:00010000:1.0:1787781806.856807:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781806.856810:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781806.856811:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781806.856831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781806.857262:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023708928 00000100:00100000:1.0:1787781806.857265:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023708928 00010000:00010000:1.0:1787781806.857281:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453d6e expref: 12 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781806.857304:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781806.857308:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059434a6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:3306:x1874625023708928:12345-0@lo:103: 00010000:00010000:1.0:1787781806.857315:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781806.857318:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453d6e expref: 12 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857324:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453d6e expref: 12 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857333:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007f8153b7/0x3ad9816c90453d75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453d6e expref: 12 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857342:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857347:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857355:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857358:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857368:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857374:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857379:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044191006 already unused, calling callback (000000005cee74a7) 00010000:00010000:1.0:1787781806.857383:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857389:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857407:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781806.857416:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781806.857443:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781806.857451:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781806.857456:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044191006/0x3ad9816c90453db4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781806.857458:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059434a6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:3306:x1874625023708928:12345-0@lo:103: Request processed in 150us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781806.857465:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787781806.857948:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c11649d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023708928:0@lo:103: 00010000:00010000:1.0:1787781807.294185:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781808.318027:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781809.342050:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000352ca05e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023709056:0@lo:400: 00000100:00100000:2.0:1787781809.342131:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781809.342184:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781809.342189:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000240d052 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023709184:0@lo:400: 00000100:00100000:2.0:1787781809.342216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781809.342249:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023709056 00000100:00100000:2.0:1787781809.342257:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023709056 00000100:00100000:2.0:1787781809.342298:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787781809.342306:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e84664c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:3303:x1874625023709056:12345-0@lo:400: 00000100:00100000:2.0:1787781809.342348:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e84664c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:3303:x1874625023709056:12345-0@lo:400: Request processed in 43us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781809.342355:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787781809.342384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023709184 00000100:00100000:2.0:1787781809.342388:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023709184 00000100:00100000:2.0:1787781809.342418:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781809.342423:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000956ad574 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023709184:12345-0@lo:400: 00000100:00100000:2.0:1787781809.342452:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000956ad574 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023709184:12345-0@lo:400: Request processed in 29us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781809.342458:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787781809.342490:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000240d052 x1874625023709184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781809.342503:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000240d052 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023709184:0@lo:400: 00000100:00100000:2.0:1787781809.342511:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000352ca05e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023709056:0@lo:400: 00010000:00010000:0.0:1787781809.343006:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781810.370575:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781811.391926:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787781811.956954:0:6692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787781811.956958:0:6692:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787781811.957097:0:6692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c87e6b7d 00000020:01000004:0.0:1787781811.957114:0:6692:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787781811.957131:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787781811.957155:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000e8eb5b66) 00000020:00000080:0.0:1787781811.957173:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787781811.974113:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787781811.974375:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787781812.000423:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787781812.007095:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787781812.007127:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787781812.007179:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787781812.007203:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787781812.007498:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787781812.007508:0:6692:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787781812.007518:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3ad9816c90453dc2 00000020:01000004:0.0:1787781812.007525:0:6692:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787781812.007545:0:6692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787781812.007548:0:6692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787781812.007553:0:6692:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787781812.007557:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787781812.007645:0:6692:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000a6f10584) 00000020:00000080:0.0:1787781812.007659:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787781812.009299:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781812.009465:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787781812.009472:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787781812.011220:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787781812.011230:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787781812.015911:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787781812.015931:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787781812.018962:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787781812.019160:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787781812.019166:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787781812.021662:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787781812.021675:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787781812.050151:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787781812.050354:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787781812.050358:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787781812.053388:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787781812.053402:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787781812.054339:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787781812.054348:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787781812.058252:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787781812.058456:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787781812.058463:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787781812.059248:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787781812.059256:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787781812.102041:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787781812.102255:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787781812.102262:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787781812.105020:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787781812.105038:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787781812.105490:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787781812.105514:0:6692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787781812.105520:0:6692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787781812.124883:0:6692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787781812.124921:0:6692:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787781812.124925:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787781812.124927:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787781812.124929:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781812.124930:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781812.124931:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781812.124933:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781812.124934:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781812.124935:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781812.124936:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781812.124938:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781812.124939:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781812.124942:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787781812.124945:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787781812.124946:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787781812.124947:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781812.124948:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781812.124949:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781812.124950:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781812.124950:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781812.124951:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781812.124952:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781812.124953:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781812.124954:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781812.124989:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787781812.125006:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f279e024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023709312:0@lo:253: 00000100:00100000:3.0:1787781812.125080:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781812.125189:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9698f5f going to sleep for 11 seconds 00000100:00100000:1.0:1787781812.125253:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023709312 00000100:00100000:1.0:1787781812.125262:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023709312 00000100:00100000:1.0:1787781812.125310:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781812.125317:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001884afa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023709312:12345-0@lo:253: 20000000:01000000:1.0:1787781812.125351:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787781812.125356:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787781812.125364:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787781812.125367:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787781812.126685:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781812.127061:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787781812.127075:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787781812.127112:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787781812.127120:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787781812.127149:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787781812.127218:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787781812.127676:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787781812.127696:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:1.0:1787781812.127699:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:1.0:1787781812.127743:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787781812.127752:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787781812.127826:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787781812.127836:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:1.0:1787781812.127870:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787781812.127880:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787781812.127908:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787781812.127968:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787781812.128961:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787781812.128982:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:1.0:1787781812.128983:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:1.0:1787781812.129019:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787781812.129027:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787781812.129056:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787781812.129063:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:1.0:1787781812.129107:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787781812.129116:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787781812.129149:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787781812.129183:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787781812.129198:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787781812.129209:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787781812.129213:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787781812.129225:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787781812.129228:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787781812.129260:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787781812.129262:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787781812.130263:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787781812.130328:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787781812.130374:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787781812.131050:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787781812.131097:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787781812.131131:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787781812.131143:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787781812.131145:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787781812.131635:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787781812.131968:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787781812.132005:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787781812.132061:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787781812.132074:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787781812.132076:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787781812.132742:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787781812.133136:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787781812.133197:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787781812.133477:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787781812.133519:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787781812.133658:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787781812.133676:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787781812.133678:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787781812.133688:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787781812.133705:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.133733:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453cf0 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.133741:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453d0c expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.133756:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453d7c expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.133764:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.134049:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453d7c expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.134064:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453d7c expref: 11 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781812.134077:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000240d052 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1874625023709440:0@lo:104: 00000100:00100000:2.0:1787781812.134141:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781812.134233:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453d0c expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.134240:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453d0c expref: 11 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781812.134249:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005b62145 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1874625023709568:0@lo:104: 00000100:00100000:2.0:1787781812.134278:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781812.134365:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453cf0 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.134373:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453cf0 expref: 11 pid: 5825 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781812.134380:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000729c70a2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1874625023709696:0@lo:104: 00000100:00100000:2.0:1787781812.134410:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781812.134473:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023709440 00000100:00100000:0.0:1787781812.134482:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023709440 00000100:00100000:0.0:1787781812.134519:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023709568 00000100:00100000:0.0:1787781812.134522:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023709568 00000100:00100000:0.0:1787781812.134536:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781812.134542:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b610a90d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:5827:x1874625023709440:12345-0@lo:104: 00010000:00010000:0.0:1787781812.134554:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.134622:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781812.134627:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b610a90d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:5827:x1874625023709440:12345-0@lo:104: Request processed in 85us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.134634:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781812.134651:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781812.134656:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f433f46e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5827:x1874625023709568:12345-0@lo:104: 00010000:00010000:0.0:1787781812.134663:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.134695:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781812.134700:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f433f46e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5827:x1874625023709568:12345-0@lo:104: Request processed in 44us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.134705:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787781812.134776:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787781812.134782:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134806:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f8a14821 already unused, calling callback (00000000f0f42387) 10000000:00010000:1.0:1787781812.134809:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134816:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781812.134822:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781812.134838:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781812.134875:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134882:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781812.134899:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134905:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000f8a14821/0x3ad9816c90453d7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d83 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134918:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781812.134920:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134925:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001c7e8bb9 already unused, calling callback (00000000f0f42387) 10000000:00010000:1.0:1787781812.134927:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134932:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781812.134938:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781812.134942:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781812.134953:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134959:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781812.134970:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134976:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453d13 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.134987:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781812.134988:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781812.134990:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781812.136154:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b36a0282 going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.136189:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000240d052 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1874625023709440:0@lo:104: 00000100:00100000:2.0:1787781812.136199:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005b62145 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1874625023709568:0@lo:104: 00000100:00100000:1.0:1787781812.136311:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023709696 00000100:00100000:1.0:1787781812.136318:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023709696 00000100:00100000:1.0:1787781812.136350:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787781812.136355:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001672998f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5827:x1874625023709696:12345-0@lo:104: 00010000:00010000:1.0:1787781812.136366:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.136427:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787781812.136432:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001672998f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5827:x1874625023709696:12345-0@lo:104: Request processed in 77us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781812.136437:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787781812.136484:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781812.136489:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.136496:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be4bd9f0 already unused, calling callback (00000000f0f42387) 10000000:00010000:0.0:1787781812.136499:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.136519:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781812.136525:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781812.136530:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781812.136562:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.136576:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781812.136590:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.136596:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000be4bd9f0/0x3ad9816c90453cf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453cf7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.136611:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781812.136612:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781812.136613:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781812.136747:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d19056e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023710080:0@lo:103: 00000100:00100000:2.0:1787781812.136825:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781812.136874:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000729c70a2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1874625023709696:0@lo:104: 00010000:00010000:2.0:1787781812.136900:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781812.136968:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023710080 00000100:00100000:0.0:1787781812.136972:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023710080 00010000:00010000:0.0:1787781812.136990:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453cf0 expref: 12 pid: 5825 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781812.137013:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781812.137019:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094ce4a48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:3303:x1874625023710080:12345-0@lo:103: 00010000:00010000:0.0:1787781812.137029:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781812.137033:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453cf0 expref: 12 pid: 5825 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.137048:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453cf0 expref: 12 pid: 5825 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.137061:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3d2135c/0x3ad9816c90453cf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453cf0 expref: 12 pid: 5825 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.137074:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781812.137103:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094ce4a48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:3303:x1874625023710080:12345-0@lo:103: Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.137109:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787781812.137213:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d19056e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023710080:0@lo:103: 00010000:00010000:3.0:1787781812.137697:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781812.137710:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059d4465a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023709824:0@lo:103: 00000100:00100000:3.0:1787781812.137754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781812.137977:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781812.137983:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e3695c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023709952:0@lo:103: 00000100:00100000:3.0:1787781812.138008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781812.138183:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023709824 00000100:00100000:2.0:1787781812.138190:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023709824 00010000:00010000:2.0:1787781812.138212:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453d7c expref: 11 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781812.138271:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023709952 00000100:00100000:2.0:1787781812.138275:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023709952 00010000:00010000:2.0:1787781812.138288:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453d0c expref: 12 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781812.138319:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781812.138327:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b050702 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:3305:x1874625023709824:12345-0@lo:103: 00010000:00010000:0.0:1787781812.138337:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781812.138340:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453d7c expref: 12 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138350:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453d7c expref: 12 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138362:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001aa6227d/0x3ad9816c90453d83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453d7c expref: 12 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138373:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781812.138409:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b050702 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:3305:x1874625023709824:12345-0@lo:103: Request processed in 84us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.138416:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781812.138428:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787781812.138432:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ef00360 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:3305:x1874625023709952:12345-0@lo:103: 00010000:00010000:0.0:1787781812.138444:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781812.138447:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453d0c expref: 10 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138455:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453d0c expref: 10 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138463:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000033a79fec/0x3ad9816c90453d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453d0c expref: 10 pid: 5826 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138472:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138479:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138491:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138497:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138502:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138509:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138515:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008b545e29 already unused, calling callback (000000005cee74a7) 00010000:00010000:0.0:1787781812.138518:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138534:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138549:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.138558:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781812.138590:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ef00360 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:3305:x1874625023709952:12345-0@lo:103: Request processed in 158us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.138596:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787781812.138644:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e3695c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023709952:0@lo:103: 00000100:00100000:3.0:1787781812.138651:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059d4465a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023709824:0@lo:103: 00010000:00010000:3.0:1787781812.138855:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781812.138864:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781812.138870:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008b545e29/0x3ad9816c90453dd0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787781812.138883:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787781812.184861:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001884afa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+8:6692:x1874625023709312:12345-0@lo:253: Request processed in 59536us (59772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.184878:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781812.185038:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f279e024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023709312:0@lo:253: 10000000:01000000:1.0:1787781812.185056:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787781812.185059:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787781812.185061:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787781812.185062:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787781812.185064:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787781812.185065:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787781812.185066:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787781812.185068:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787781812.185069:0:6692:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787781812.185071:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787781812.185072:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787781812.185107:0:6692:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c87e6b7d from lustre-OST0000 10000000:01000000:1.0:1787781812.185130:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787781812.185133:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787781812.185140:0:6692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ef450c2b370 local copy 10000000:01000000:1.0:1787781812.185143:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787781812.185178:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.185188:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.185195:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781812.185213:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710208:0@lo:101: 00000100:00100000:1.0:1787781812.185249:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781812.185305:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000deaa8282 going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.185432:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023710208 00000100:00100000:2.0:1787781812.185440:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023710208 00000100:00100000:2.0:1787781812.185488:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787781812.185497:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ef51e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+8:6692:x1874625023710208:12345-0@lo:101: 00010000:00010000:2.0:1787781812.185509:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781812.185521:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000026b7a0cf/0x3ad9816c90453dde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453dd7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.185555:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026b7a0cf/0x3ad9816c90453dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453dd7 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.185565:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000026b7a0cf/0x3ad9816c90453dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453dd7 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.185683:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000026b7a0cf, rc 0) 00000100:00100000:2.0:1787781812.185722:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ef51e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:6692:x1874625023710208:12345-0@lo:101: Request processed in 227us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781812.185736:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787781812.185814:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710208:0@lo:101: 00010000:00010000:1.0:1787781812.185827:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.185835:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781812.185945:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710336:0@lo:501: 00000100:00100000:1.0:1787781812.185971:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781812.185998:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000deaa8282 going to sleep for 11 seconds 00000100:00100000:0.0:1787781812.186050:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023710336 00000100:00100000:0.0:1787781812.186055:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023710336 00000100:00100000:0.0:1787781812.186088:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787781812.186094:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c44d385c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:6692:x1874625023710336:12345-0@lo:501: 00000100:00100000:0.0:1787781812.186290:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c44d385c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:6692:x1874625023710336:12345-0@lo:501: Request processed in 196us (318us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787781812.186298:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787781812.186420:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710336:0@lo:501: 10000000:01000000:1.0:1787781812.186433:0:6692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787781812.186462:0:6692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787781812.186466:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.186474:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.186479:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.186501:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787781812.186518:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef450a67000 10000000:01000000:1.0:1787781812.186522:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787781812.186526:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ef450c2b370 10000000:01000000:1.0:1787781812.186528:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787781812.186534:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ef450c2b370 from 1 10000000:01000000:1.0:1787781812.186536:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787781812.186552:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 0000000069f2f37d/0x3ad9816c90453de5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.186559:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 0000000069f2f37d/0x3ad9816c90453de5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.186565:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 0000000069f2f37d/0x3ad9816c90453de5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.186656:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781812.186662:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.186669:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001c7e8bb9 already unused, calling callback (00000000f0f42387) 10000000:00010000:0.0:1787781812.186672:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.186688:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781812.186695:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781812.186700:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781812.186717:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.186722:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781812.186755:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.186762:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 000000001c7e8bb9/0x3ad9816c90453dd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ad9816c90453dde expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.186779:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781812.186780:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781812.186782:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781812.186826:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781812.186838:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023710592:0@lo:103: 00000100:00100000:0.0:1787781812.186868:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781812.186905:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023710592 00000100:00100000:0.0:1787781812.186909:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023710592 00000100:00100000:0.0:1787781812.186938:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781812.186945:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008acc700f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:3303:x1874625023710592:12345-0@lo:103: 00010000:00010000:0.0:1787781812.186953:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781812.186963:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000026b7a0cf/0x3ad9816c90453dde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90453dd7 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.186981:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781812.187009:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008acc700f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+8:3303:x1874625023710592:12345-0@lo:103: Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.187016:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781812.187042:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023710592:0@lo:103: 00000100:00100000:1.0:1787781812.187162:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710464:0@lo:101: 00000100:00100000:1.0:1787781812.187186:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781812.187208:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e3a25bb going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.187261:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023710464 00000100:00100000:2.0:1787781812.187266:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023710464 00000100:00100000:2.0:1787781812.187295:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787781812.187300:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1defa85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+8:6692:x1874625023710464:12345-0@lo:101: 00010000:00010000:2.0:1787781812.187308:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781812.187317:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb86e1d1/0x3ad9816c90453dec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453de5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.187331:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb86e1d1/0x3ad9816c90453dec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453de5 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.187339:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb86e1d1/0x3ad9816c90453dec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453de5 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.187345:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb86e1d1, rc 0) 00000100:00100000:2.0:1787781812.187377:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1defa85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:6692:x1874625023710464:12345-0@lo:101: Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781812.187383:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787781812.187455:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710464:0@lo:101: 00010000:00010000:1.0:1787781812.187471:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 0000000069f2f37d/0x3ad9816c90453de5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453dec expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.187478:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 0000000069f2f37d/0x3ad9816c90453de5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453dec expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781812.187494:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787781812.187579:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 0000000069f2f37d/0x3ad9816c90453de5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453dec expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.187586:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 0000000069f2f37d/0x3ad9816c90453de5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453dec expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781812.187593:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787781812.187597:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787781812.187602:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787781812.187604:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787781812.187617:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000d1be19b8/0x3ad9816c90453df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.187622:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000d1be19b8/0x3ad9816c90453df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.187628:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000d1be19b8/0x3ad9816c90453df3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781812.187638:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710720:0@lo:101: 00000100:00100000:1.0:1787781812.187662:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781812.187681:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e3a25bb going to sleep for 11 seconds 00000100:00100000:0.0:1787781812.187784:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023710720 00000100:00100000:0.0:1787781812.187815:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023710720 00000100:00100000:0.0:1787781812.187839:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787781812.187845:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002913516f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:6692:x1874625023710720:12345-0@lo:101: 00010000:00010000:0.0:1787781812.187853:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781812.187861:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001aa6227d/0x3ad9816c90453dfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453df3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.187874:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001aa6227d/0x3ad9816c90453dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453df3 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.187881:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001aa6227d/0x3ad9816c90453dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453df3 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.187887:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001aa6227d, rc 0) 00000100:00100000:0.0:1787781812.187914:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002913516f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023710720:12345-0@lo:101: Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.187920:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787781812.188286:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710720:0@lo:101: 00010000:00010000:1.0:1787781812.188306:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000d1be19b8/0x3ad9816c90453df3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.188313:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000d1be19b8/0x3ad9816c90453df3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781812.188389:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710848:0@lo:501: 00000100:00100000:1.0:1787781812.188415:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781812.188444:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e3a25bb going to sleep for 11 seconds 00000100:00100000:0.0:1787781812.188492:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023710848 00000100:00100000:0.0:1787781812.188497:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023710848 00000100:00100000:0.0:1787781812.188529:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787781812.188535:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb89e41e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023710848:12345-0@lo:501: 00000100:00100000:0.0:1787781812.188769:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb89e41e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023710848:12345-0@lo:501: Request processed in 234us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.188777:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787781812.188920:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055d55a71 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710848:0@lo:501: 00000100:00100000:3.0:1787781812.188949:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2e1fb0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710976:0@lo:503: 00000100:00100000:3.0:1787781812.188989:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781812.189017:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070dbf303 going to sleep for 11 seconds 00000100:00100000:1.0:1787781812.189072:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023710976 00000100:00100000:1.0:1787781812.189076:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023710976 00000100:00100000:1.0:1787781812.189105:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787781812.189110:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab4af5bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023710976:12345-0@lo:503: 00000100:00100000:1.0:1787781812.189235:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab4af5bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023710976:12345-0@lo:503: Request processed in 125us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781812.189240:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787781812.189319:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2e1fb0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023710976:0@lo:503: 00000040:00080000:3.0:1787781812.189590:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787781812.189648:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2e1fb0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711104:0@lo:502: 00000100:00100000:3.0:1787781812.189685:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781812.189710:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070dbf303 going to sleep for 11 seconds 00000100:00100000:1.0:1787781812.189839:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023711104 00000100:00100000:1.0:1787781812.189843:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023711104 00000100:00100000:1.0:1787781812.189876:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787781812.189882:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f58dadb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023711104:12345-0@lo:502: 00000100:00100000:1.0:1787781812.190009:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f58dadb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023711104:12345-0@lo:502: Request processed in 128us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781812.190016:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787781812.190105:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2e1fb0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711104:0@lo:502: 00000040:00080000:3.0:1787781812.190356:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787781812.190404:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787781812.190439:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787781812.190485:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787781812.190522:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787781812.190565:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787781812.190954:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2e1fb0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711232:0@lo:502: 00000100:00100000:3.0:1787781812.191002:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781812.191028:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070dbf303 going to sleep for 11 seconds 00000100:00100000:0.0:1787781812.191119:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023711232 00000100:00100000:0.0:1787781812.191124:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023711232 00000100:00100000:0.0:1787781812.191158:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787781812.191164:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009485050e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023711232:12345-0@lo:502: 00000100:00100000:0.0:1787781812.191307:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009485050e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023711232:12345-0@lo:502: Request processed in 143us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.191314:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787781812.191405:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2e1fb0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711232:0@lo:502: 00000040:00080000:3.0:1787781812.191489:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787781812.191498:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787781812.192100:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787781812.192109:0:6710:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787781812.192115:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781812.192117:0:6710:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787781812.192122:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787781812.192136:0:6710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000937572df) 00000020:00000080:0.0:1787781812.192155:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787781812.192160:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787781812.192214:0:6710:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c87e6b7d from lustre-OST0000, refs=2 00080000:01000000:0.0:1787781812.192221:0:6710:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787781812.192226:0:6710:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3ad9816c90453e08 00010000:00010000:1.0:1787781812.199057:0:6710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787781812.199364:0:6710:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787781812.206851:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787781812.207161:0:6710:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787781812.214230:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787781812.214767:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787781812.216188:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787781812.216200:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781812.216206:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781812.216208:0:6710:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787781812.216211:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781812.216214:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781812.216215:0:6710:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787781812.216218:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787781812.216219:0:6710:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787781812.216263:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781812.216267:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781812.216268:0:6710:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787781812.216271:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787781812.219950:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787781812.219993:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787781812.220126:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000d1be19b8/0x3ad9816c90453df3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.220140:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000d1be19b8/0x3ad9816c90453df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781812.220148:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef450a67000 from 1 10000000:01000000:0.0:1787781812.220157:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787781812.220195:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000d0f5dafb/0x3ad9816c90453e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.220202:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000d0f5dafb/0x3ad9816c90453e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.220212:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000d0f5dafb/0x3ad9816c90453e0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781812.220234:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711360:0@lo:101: 00000100:00100000:0.0:1787781812.220296:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781812.220349:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b93fb8c2 going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.220411:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023711360 00000100:00100000:2.0:1787781812.220418:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023711360 00000100:00100000:2.0:1787781812.220465:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787781812.220473:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4410dcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+10:6692:x1874625023711360:12345-0@lo:101: 00010000:00010000:2.0:1787781812.220485:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781812.220497:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006572bf06/0x3ad9816c90453e16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453e0f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.220518:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006572bf06/0x3ad9816c90453e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453e0f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.220528:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006572bf06/0x3ad9816c90453e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e0f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.220536:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006572bf06, rc 0) 00000100:00100000:0.0:1787781812.220692:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711360:0@lo:101: 00010000:00010000:0.0:1787781812.220705:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000d0f5dafb/0x3ad9816c90453e0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.220713:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000d0f5dafb/0x3ad9816c90453e0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781812.220871:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711488:0@lo:501: 00000100:00100000:0.0:1787781812.224640:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781812.224693:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b93fb8c2 going to sleep for 11 seconds 00000100:00100000:3.0:1787781812.224859:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023711488 00000100:00100000:3.0:1787781812.224867:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023711488 00000100:00100000:3.0:1787781812.224910:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787781812.224918:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002903a725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023711488:12345-0@lo:501: 00000100:00100000:3.0:1787781812.225183:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002903a725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023711488:12345-0@lo:501: Request processed in 265us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781812.225191:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787781812.225283:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4410dcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023711360:12345-0@lo:101: Request processed in 4809us (4985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781812.225291:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787781812.225408:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711488:0@lo:501: 00000100:00100000:0.0:1787781812.225455:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711616:0@lo:503: 00000100:00100000:0.0:1787781812.225497:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781812.225525:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b93fb8c2 going to sleep for 11 seconds 00000100:00100000:3.0:1787781812.225639:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023711616 00000100:00100000:3.0:1787781812.225644:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023711616 00000100:00100000:3.0:1787781812.225707:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787781812.225715:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5812b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023711616:12345-0@lo:503: 00000100:00100000:3.0:1787781812.226008:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5812b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023711616:12345-0@lo:503: Request processed in 294us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781812.226015:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787781812.226583:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711616:0@lo:503: 00000040:00080000:0.0:1787781812.226916:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787781812.226981:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711744:0@lo:502: 00000100:00100000:0.0:1787781812.227030:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781812.227294:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000968cb0df going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.227366:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023711744 00000100:00100000:2.0:1787781812.227372:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023711744 00000100:00100000:2.0:1787781812.227402:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787781812.227408:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006948c449 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023711744:12345-0@lo:502: 00000100:00100000:2.0:1787781812.227678:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006948c449 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023711744:12345-0@lo:502: Request processed in 269us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781812.227685:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787781812.227775:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711744:0@lo:502: 00000040:00080000:0.0:1787781812.228069:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787781812.228122:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787781812.228148:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711872:0@lo:502: 00000100:00100000:0.0:1787781812.228183:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781812.228202:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000968cb0df going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.228268:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023711872 00000100:00100000:2.0:1787781812.228273:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023711872 00000100:00100000:2.0:1787781812.228293:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787781812.228298:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c98f7b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023711872:12345-0@lo:502: 00000100:00100000:2.0:1787781812.228424:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c98f7b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023711872:12345-0@lo:502: Request processed in 125us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781812.228430:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787781812.228513:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fb71a46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023711872:0@lo:502: 00000040:00080000:0.0:1787781812.228666:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787781812.228676:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787781812.229209:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781812.229218:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781812.229220:0:6714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787781812.229227:0:6714:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef450a67000 00000020:00000080:3.0:1787781812.229229:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787781812.229268:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781812.229272:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781812.229281:0:6714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787781812.229285:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787781812.229409:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787781812.229430:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787781812.229454:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.229467:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781812.229506:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787781812.229509:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef450a67000 10000000:01000000:2.0:1787781812.229512:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef450a67000 10000000:01000000:2.0:1787781812.229516:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787781812.229521:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef450a67000 from 1 10000000:01000000:2.0:1787781812.229524:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781812.229551:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.229560:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.229649:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781812.229667:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712000:0@lo:101: 00000100:00100000:2.0:1787781812.229707:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781812.229747:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.229770:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023712000 00000100:00100000:2.0:1787781812.229775:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023712000 00000100:00100000:2.0:1787781812.229829:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787781812.229838:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023712000:12345-0@lo:101: 00010000:00010000:2.0:1787781812.229847:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781812.229859:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453e1d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.229882:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453e1d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.229893:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e1d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.229901:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8a00, rc 0) 00000100:00100000:2.0:1787781812.229936:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712000:12345-0@lo:101: Request processed in 99us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781812.229942:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787781812.229983:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712000:0@lo:101: 00010000:00010000:2.0:1787781812.229995:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.230003:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781812.230077:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712128:0@lo:501: 00000100:00100000:2.0:1787781812.230099:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781812.230111:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.230122:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023712128 00000100:00100000:2.0:1787781812.230130:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023712128 00000100:00100000:2.0:1787781812.230149:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787781812.230155:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712128:12345-0@lo:501: 00000100:00100000:2.0:1787781812.230340:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712128:12345-0@lo:501: Request processed in 184us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781812.230346:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787781812.230376:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712128:0@lo:501: 00000100:00100000:2.0:1787781812.230401:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712256:0@lo:503: 00000100:00100000:2.0:1787781812.230434:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781812.230446:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.230458:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023712256 00000100:00100000:2.0:1787781812.230462:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023712256 00000100:00100000:2.0:1787781812.230481:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787781812.230487:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712256:12345-0@lo:503: 00000100:00100000:2.0:1787781812.231026:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712256:12345-0@lo:503: Request processed in 537us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781812.231033:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787781812.231174:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712256:0@lo:503: 00000040:00080000:3.0:1787781812.231431:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787781812.231490:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712384:0@lo:502: 00000100:00100000:3.0:1787781812.231528:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781812.231683:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446256c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781812.231718:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023712384 00000100:00100000:2.0:1787781812.231731:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023712384 00000100:00100000:3.0:1787781812.231998:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787781812.232007:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712384:12345-0@lo:502: 00000100:00100000:3.0:1787781812.232195:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712384:12345-0@lo:502: Request processed in 189us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781812.232202:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787781812.232319:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712384:0@lo:502: 00000040:00080000:2.0:1787781812.232565:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787781812.232628:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787781812.232666:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787781812.232716:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787781812.232770:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787781812.232859:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787781812.232898:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787781812.232933:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787781812.232996:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787781812.233031:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787781812.233066:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787781812.233111:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787781812.233153:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787781812.233179:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787781812.233217:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787781812.233243:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787781812.233267:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787781812.233301:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787781812.233327:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787781812.233351:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787781812.233386:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787781812.233412:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787781812.233437:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787781812.233471:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787781812.233498:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787781812.233522:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787781812.233556:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787781812.233581:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787781812.233609:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712512:0@lo:502: 00000100:00100000:2.0:1787781812.233658:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781812.234225:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781812.234319:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023712512 00000100:00100000:0.0:1787781812.234326:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023712512 00000100:00100000:3.0:1787781812.234430:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787781812.234438:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712512:12345-0@lo:502: 00000100:00100000:3.0:1787781812.234818:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712512:12345-0@lo:502: Request processed in 352us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781812.234826:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787781812.234919:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712512:0@lo:502: 00000040:00080000:2.0:1787781812.235022:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787781812.235037:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787781812.235658:0:6715:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787781812.235671:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ef450c7b370) 00000020:00000080:2.0:1787781812.235691:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787781812.235769:0:6715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef450a67000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787781812.235773:0:6715:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef450a67000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787781812.235784:0:6715:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef450a67000 3 00010000:00080000:2.0:1787781812.235844:0:6715:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef444bc7000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1787781812.237496:0:6715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787781812.239292:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787781812.239329:0:6715:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787781812.239342:0:6715:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3ad9816c90453e32 00000100:00080000:2.0:1787781812.239352:0:6715:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787781812.239358:0:6715:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ef444bc7000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1787781812.239393:0:6715:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef462058f00 x1874625023712640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787781812.239421:0:6715:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787781812.239541:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874625023712640:0@lo:38: 00000100:00100000:3.0:1787781812.239688:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781812.239755:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023712768:0@lo:400: 00000100:00100000:3.0:1787781812.239782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781812.239848:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023712640 00000100:00100000:3.0:1787781812.239855:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023712640 00000100:00100000:3.0:1787781812.239878:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023712768 00000100:00100000:3.0:1787781812.239881:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023712768 00000100:00100000:3.0:1787781812.239905:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787781812.239913:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023712768:12345-0@lo:400: 00000100:00100000:3.0:1787781812.239972:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023712768:12345-0@lo:400: Request processed in 59us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781812.239981:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787781812.239997:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787781812.240001:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a763840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874625023712640:12345-0@lo:38: 00010000:00080000:3.0:1787781812.240020:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1787781812.240047:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3ad9816c90453e39 00000004:00100000:3.0:1787781812.240061:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787781812.240093:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9ef481805800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781812.240133:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a763840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874625023712640:12345-0@lo:38: Request processed in 130us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781812.240139:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787781812.240176:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef462058b40 x1874625023712768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781812.240189:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023712768:0@lo:400: 00010000:00080000:3.0:1787781812.240214:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef462058f00 x1874625023712640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787781822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781812.240222:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787781812.240228:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787781812.240236:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787781812.240240:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787781812.240242:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef444bc7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787781812.240248:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874625023712640:0@lo:38: 00000040:00080000:2.0:1787781812.240939:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787781812.241163:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787781812.241188:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787781812.241210:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.241221:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787781812.241265:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787781812.241267:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787781812.241269:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781812.241270:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781812.241271:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781812.241272:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781812.241274:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787781812.241275:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781812.241277:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781812.241278:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781812.241280:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787781812.241283:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787781812.241289:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787781812.241290:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787781812.241291:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781812.241292:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781812.241292:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781812.241293:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781812.241294:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787781812.241295:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781812.241296:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781812.241297:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781812.241297:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787781812.241314:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787781812.241326:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712896:0@lo:253: 00000100:00100000:2.0:1787781812.241372:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781812.241401:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023712896 00000100:00100000:2.0:1787781812.241406:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023712896 00000100:00100000:2.0:1787781812.241436:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787781812.241443:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6692:x1874625023712896:12345-0@lo:253: 20000000:01000000:2.0:1787781812.241475:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787781812.241488:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787781812.242241:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590240 going to sleep for 11 seconds 20000000:01000000:0.0:1787781812.272187:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787781812.272208:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787781812.272297:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787781812.272302:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787781812.272325:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.272345:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef440031000/0x3ad9816c90453dad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453da6 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.272354:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.272393:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef440031000/0x3ad9816c90453dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453da6 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.272428:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef440031000/0x3ad9816c90453dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453da6 expref: 12 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781812.272445:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874625023713024:0@lo:104: 00000100:00100000:2.0:1787781812.272510:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781812.272684:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f5909c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781812.272837:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023713024 00000100:00100000:1.0:1787781812.272844:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023713024 00000100:00100000:1.0:1787781812.272895:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787781812.272905:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462058b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5849:x1874625023713024:12345-0@lo:104: 00010000:00010000:1.0:1787781812.272917:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c90453da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781812.272969:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787781812.272975:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462058b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5849:x1874625023713024:12345-0@lo:104: Request processed in 73us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781812.272981:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787781812.273336:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874625023713024:0@lo:104: 00010000:00010000:2.0:1787781812.273355:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275071:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781812.275084:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c90453da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275096:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9e00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787781812.275101:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c90453da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275112:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c90453da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781812.275139:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c90453da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781812.275145:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781812.275191:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c90453da6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275198:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781812.275220:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c90453da6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275227:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c90453da6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453dad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275245:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781812.275247:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781812.275249:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781812.275265:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023713152:0@lo:103: 00000100:00100000:0.0:1787781812.275330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781812.275389:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023713152 00000100:00100000:0.0:1787781812.275395:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023713152 00010000:00010000:0.0:1787781812.275420:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef440031000/0x3ad9816c90453dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453da6 expref: 13 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781812.275447:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787781812.275455:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450caa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:3306:x1874625023713152:12345-0@lo:103: 00010000:00010000:0.0:1787781812.275468:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781812.275473:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef440031000/0x3ad9816c90453dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453da6 expref: 13 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275491:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef440031000/0x3ad9816c90453dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453da6 expref: 13 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275506:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440031000/0x3ad9816c90453dad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453da6 expref: 13 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275520:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275529:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787781812.275546:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003244285s 00010000:00010000:0.0:1787781812.275551:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275558:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275565:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275584:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275589:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787781812.275594:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275601:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275623:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781812.275633:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781812.275665:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450caa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:3306:x1874625023713152:12345-0@lo:103: Request processed in 209us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781812.275673:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787781812.275757:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023713152:0@lo:103: 00010000:00010000:2.0:1787781812.276069:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.276078:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781812.276084:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453e40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781812.285423:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:6692:x1874625023712896:12345-0@lo:253: Request processed in 43970us (44040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781812.285438:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787781812.285539:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:6692:1874625023712896:0@lo:253: 10000000:01000000:3.0:1787781812.285628:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787781812.285632:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787781812.285634:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787781812.285635:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781812.285637:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781812.285638:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781812.285639:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781812.285640:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781812.285641:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781812.285643:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781812.285644:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781812.285645:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787781812.285662:0:6692:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787781812.290514:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787781812.290843:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787781812.291063:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787781812.291245:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787781812.291457:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787781812.291928:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787781812.293069:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1787781812.430674:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787781812.502981:0:6692:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787781812.502991:0:6692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787781812.503028:0:6692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787781812.503080:0:6692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787781812.503093:0:6692:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787781812.503120:0:6692:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787781813.441572:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787781813.823464:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787781813.823472:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef4450df800 from 21 10000000:01000000:3.0:1787781813.823477:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787781813.823522:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.823535:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.823547:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781813.823570:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023713280:0@lo:101: 00000100:00100000:3.0:1787781813.823646:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.823728:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781813.823756:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023713280 00000100:00100000:1.0:1787781813.823765:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023713280 00000100:00100000:1.0:1787781813.823838:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787781813.823848:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:5830:x1874625023713280:12345-0@lo:101: 00010000:00010000:1.0:1787781813.823862:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781813.823874:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453e47 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781813.823898:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453e47 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781813.823909:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e47 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781813.823918:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef441481400, rc 0) 00000100:00100000:1.0:1787781813.823972:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023713280:12345-0@lo:101: Request processed in 125us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781813.823979:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787781813.824089:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023713280:0@lo:101: 00010000:00010000:3.0:1787781813.824104:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.824113:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781813.824169:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023713408:0@lo:501: 00000100:00100000:3.0:1787781813.824193:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.824252:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963900 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.826013:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023713408 00000100:00100000:2.0:1787781813.826024:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023713408 00000100:00100000:2.0:1787781813.826078:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787781813.826089:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023713408:12345-0@lo:501: 00000100:00100000:2.0:1787781813.826477:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023713408:12345-0@lo:501: Request processed in 390us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.826494:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787781813.826541:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023713408:0@lo:501: 00000100:00100000:2.0:1787781813.826583:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023713536:0@lo:503: 00000100:00100000:2.0:1787781813.826621:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.826647:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4451613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.826659:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023713536 00000100:00100000:2.0:1787781813.826662:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023713536 00000100:00100000:2.0:1787781813.826685:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787781813.826692:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023713536:12345-0@lo:503: 00000100:00100000:2.0:1787781813.827035:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023713536:12345-0@lo:503: Request processed in 343us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.827042:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787781813.827083:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023713536:0@lo:503: 00000100:00100000:2.0:1787781813.827254:0:6811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6811:1874625023713664:0@lo:502: 00000100:00100000:2.0:1787781813.827293:0:6811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.827318:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023713664 00000100:00100000:2.0:1787781813.827321:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023713664 00000100:00100000:2.0:1787781813.827343:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787781813.827349:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6811:x1874625023713664:12345-0@lo:502: 00000100:00100000:2.0:1787781813.827524:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6811:x1874625023713664:12345-0@lo:502: Request processed in 174us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.827531:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787781813.827560:0:6811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.827573:0:6811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6811:1874625023713664:0@lo:502: 00000100:00100000:2.0:1787781813.827620:0:6811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6811:1874625023713792:0@lo:502: 00000100:00100000:2.0:1787781813.827657:0:6811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.827675:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023713792 00000100:00100000:2.0:1787781813.827678:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023713792 00000100:00100000:2.0:1787781813.827699:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787781813.827705:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6811:x1874625023713792:12345-0@lo:502: 00000100:00100000:2.0:1787781813.827867:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:6811:x1874625023713792:12345-0@lo:502: Request processed in 161us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.827873:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787781813.827897:0:6811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.827909:0:6811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6811:1874625023713792:0@lo:502: 00000040:00080000:2.0:1787781813.827928:0:6811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787781813.827974:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787781813.827989:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787781813.827998:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.828009:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781813.828018:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787781813.828021:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef4450df800 from 4 10000000:01000000:2.0:1787781813.828024:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787781813.828050:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.828058:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.828078:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781813.828091:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023713920:0@lo:101: 00000100:00100000:2.0:1787781813.828119:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.828133:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.828144:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023713920 00000100:00100000:2.0:1787781813.828148:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023713920 00000100:00100000:2.0:1787781813.828172:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787781813.828178:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023713920:12345-0@lo:101: 00010000:00010000:2.0:1787781813.828187:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781813.828199:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453e55 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.828218:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453e55 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.828228:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e55 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.828237:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8000, rc 0) 00000100:00100000:2.0:1787781813.828271:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023713920:12345-0@lo:101: Request processed in 93us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.828277:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787781813.828307:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023713920:0@lo:101: 00010000:00010000:2.0:1787781813.828319:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.828339:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781813.828386:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714048:0@lo:256: 00000100:00100000:2.0:1787781813.828414:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.828426:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.828437:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023714048 00000100:00100000:2.0:1787781813.828441:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023714048 00000100:00100000:2.0:1787781813.828460:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787781813.828465:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023714048:12345-0@lo:256: 20000000:01000000:2.0:1787781813.828477:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787781813.828492:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787781813.828496:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787781813.833538:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023714048:12345-0@lo:256: Request processed in 5062us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781813.833695:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714048:0@lo:256: 10000000:01000000:3.0:1787781813.833831:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787781813.833840:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.833851:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781813.833861:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787781813.833864:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787781813.833866:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787781813.833902:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.833909:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.833933:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781813.833951:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a760000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714176:0@lo:101: 00000100:00100000:2.0:1787781813.834319:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787781813.834559:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.834607:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963780 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.835320:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023714176 00000100:00100000:2.0:1787781813.835327:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023714176 00000100:00100000:2.0:1787781813.835369:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787781813.835379:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023714176:12345-0@lo:101: 00010000:00010000:2.0:1787781813.835394:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781813.835411:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453e63 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.835435:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453e63 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.835457:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e63 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.835466:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8200, rc 0) 00000100:00100000:2.0:1787781813.835516:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023714176:12345-0@lo:101: Request processed in 138us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.835524:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787781813.835566:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a760000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714176:0@lo:101: 00010000:00010000:3.0:1787781813.835582:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.835593:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781813.835651:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a760000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714304:0@lo:501: 00000100:00100000:3.0:1787781813.835692:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.835803:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963780 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.835852:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023714304 00000100:00100000:2.0:1787781813.835857:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023714304 00000100:00100000:2.0:1787781813.835884:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787781813.835891:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023714304:12345-0@lo:501: 00000100:00100000:2.0:1787781813.836139:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023714304:12345-0@lo:501: Request processed in 247us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.836145:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787781813.836317:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a760000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714304:0@lo:501: 00000100:00100000:3.0:1787781813.836345:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a760000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714432:0@lo:503: 00000100:00100000:3.0:1787781813.837178:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.837205:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963780 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.837395:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023714432 00000100:00100000:2.0:1787781813.837402:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023714432 00000100:00100000:2.0:1787781813.837439:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787781813.837446:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023714432:12345-0@lo:503: 00000100:00100000:2.0:1787781813.837831:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023714432:12345-0@lo:503: Request processed in 384us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.837838:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787781813.837888:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a760000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714432:0@lo:503: 00000100:00100000:2.0:1787781813.839770:0:6812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6812:1874625023714560:0@lo:502: 00000100:00100000:2.0:1787781813.839859:0:6812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.839887:0:6812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4451610c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781813.842912:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023714560 00000100:00100000:3.0:1787781813.842925:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023714560 00000100:00100000:3.0:1787781813.842976:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787781813.842987:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:6812:x1874625023714560:12345-0@lo:502: 00000100:00100000:3.0:1787781813.843334:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:6812:x1874625023714560:12345-0@lo:502: Request processed in 348us (3474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781813.843348:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787781813.843443:0:6812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6812:1874625023714560:0@lo:502: 00000020:01000000:2.0:1787781813.843483:0:6812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787781813.843490:0:6812:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787781813.843498:0:6812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781813.843500:0:6812:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787781813.843507:0:6812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787781813.843510:0:6812:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:2.0:1787781813.843534:0:6812:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787781813.843537:0:6812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787781813.843578:0:6812:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ef478eb19b8) 00000020:00000080:2.0:1787781813.843598:0:6812:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787781813.843605:0:6812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787781813.843696:0:6812:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787781813.843702:0:6812:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787781813.843720:0:6812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90453e78 00010000:00080000:2.0:1787781813.843758:0:6812:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef444bc7800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1787781813.843998:0:6812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787781813.928951:0:6812:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787781813.928973:0:6812:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787781813.929421:0:6812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781813.929541:0:6812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787781813.929588:0:6812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787781813.929648:0:6812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787781813.937240:0:6820:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781813.937247:0:6820:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787781813.937958:0:6812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787781813.937971:0:6812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787781813.938005:0:6812:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787781813.938039:0:6812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c90453e7f 00000100:00080000:2.0:1787781813.938051:0:6812:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787781813.938059:0:6812:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ef444bc7800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1787781813.938095:0:6812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef46205b840 x1874625023714688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787781813.938115:0:6812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787781813.938169:0:6812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781813.938178:0:6812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781813.938179:0:6812:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787781813.938183:0:6812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781813.938187:0:6812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781813.938188:0:6812:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787781813.938191:0:6812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787781813.938194:0:6812:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787781813.938220:0:6812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4620592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6812:1874625023714816:0@lo:502: 00000100:00100000:2.0:1787781813.938298:0:6812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.938339:0:6812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44505ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787781813.938413:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023714688:0@lo:8: 00000100:00100000:3.0:1787781813.938448:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.938488:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023714816 00000100:00100000:3.0:1787781813.938494:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023714816 00000100:00100000:3.0:1787781813.938529:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787781813.938537:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:6812:x1874625023714816:12345-0@lo:502: 00000100:00100000:3.0:1787781813.938772:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:6812:x1874625023714816:12345-0@lo:502: Request processed in 234us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781813.938780:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787781813.938848:0:6812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4620592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6812:1874625023714816:0@lo:502: 00000020:01000000:3.0:1787781813.938873:0:6812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781813.938878:0:6812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781813.938879:0:6812:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787781813.938887:0:6812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787781813.938980:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787781813.938996:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787781813.939005:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.939016:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781813.939037:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781813.939039:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef4450df800 from 1 10000000:01000000:3.0:1787781813.939042:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781813.939066:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.939075:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.939083:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781813.939097:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714944:0@lo:101: 00000100:00100000:3.0:1787781813.939122:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.939137:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963180 going to sleep for 11 seconds 00000100:00100000:3.0:1787781813.939153:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023714944 00000100:00100000:3.0:1787781813.939156:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023714944 00000100:00100000:3.0:1787781813.939175:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787781813.939181:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023714944:12345-0@lo:101: 00010000:00010000:3.0:1787781813.939190:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781813.939202:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453e86 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.939222:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453e86 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.939233:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e86 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.939252:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044a00, rc 0) 00000100:00100000:3.0:1787781813.939281:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023714944:12345-0@lo:101: Request processed in 99us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781813.939287:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787781813.939316:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023714944:0@lo:101: 00010000:00010000:3.0:1787781813.939327:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.939336:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781813.939372:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023715072:0@lo:501: 00000100:00100000:3.0:1787781813.939394:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.939406:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963180 going to sleep for 11 seconds 00000100:00100000:3.0:1787781813.939419:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023715072 00000100:00100000:3.0:1787781813.939422:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023715072 00000100:00100000:3.0:1787781813.939440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787781813.939446:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023715072:12345-0@lo:501: 00000100:00100000:3.0:1787781813.939638:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023715072:12345-0@lo:501: Request processed in 191us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781813.939644:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787781813.939670:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023715072:0@lo:501: 00000100:00100000:3.0:1787781813.939694:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023715200:0@lo:503: 00000100:00100000:3.0:1787781813.939742:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.939755:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963180 going to sleep for 11 seconds 00000100:00100000:3.0:1787781813.939773:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023715200 00000100:00100000:3.0:1787781813.939776:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023715200 00000100:00100000:3.0:1787781813.939815:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787781813.939821:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023715200:12345-0@lo:503: 00000100:00100000:3.0:1787781813.940059:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023715200:12345-0@lo:503: Request processed in 238us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781813.940066:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787781813.940099:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023715200:0@lo:503: 00000100:00100000:2.0:1787781813.940468:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023714688 00000100:00100000:2.0:1787781813.940473:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023714688 00000100:00100000:2.0:1787781813.940503:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781813.940508:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874625023714688:12345-0@lo:8: 00010000:00080000:2.0:1787781813.940528:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1787781813.940553:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c90453e94 00002000:00100000:2.0:1787781813.940589:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ef4809ab000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787781813.940592:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787781813.940595:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787781813.940674:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787781813.940837:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787781813.940860:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9ef4809af000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781813.940883:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023715328:0@lo:400: 00000100:00100000:2.0:1787781813.940916:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874625023714688:12345-0@lo:8: Request processed in 407us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781813.940916:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.940923:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781813.940938:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781813.940943:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023715456:0@lo:400: 00000100:00100000:0.0:1787781813.941137:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781813.941187:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023715328 00000100:00100000:0.0:1787781813.941191:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023715328 00000100:00100000:0.0:1787781813.941217:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023715456 00000100:00100000:0.0:1787781813.941219:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023715456 00000100:00100000:0.0:1787781813.941243:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781813.941249:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023715328:12345-0@lo:400: 00000100:00100000:0.0:1787781813.941286:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023715328:12345-0@lo:400: Request processed in 37us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781813.941291:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781813.941305:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781813.941311:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023715456:12345-0@lo:400: 00000100:00100000:0.0:1787781813.941338:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023715456:12345-0@lo:400: Request processed in 27us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781813.941351:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787781813.941370:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787781813.941393:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44a714780 x1874625023715456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781813.941404:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a714780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023715456:0@lo:400: 00010000:00080000:0.0:1787781813.941413:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44a716580 x1874625023715328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781813.941421:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023715328:0@lo:400: 00010000:00080000:3.0:1787781813.942444:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef46205b840 x1874625023714688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787781823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781813.942454:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787781813.942463:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787781813.942472:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787781813.942477:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787781813.942479:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef444bc7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787781813.942502:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787781813.942507:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023714688:0@lo:8: 00000004:00080000:3.0:1787781813.942545:0:6820:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787781813.944126:0:6820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 181722335137ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787781813.944239:0:6823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6823:1874625023715584:0@lo:502: 00000100:00100000:2.0:1787781813.944309:0:6823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.944349:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023715584 00000100:00100000:2.0:1787781813.944355:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023715584 00000100:00100000:2.0:1787781813.944390:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787781813.944398:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:6823:x1874625023715584:12345-0@lo:502: 00000100:00100000:2.0:1787781813.944601:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:6823:x1874625023715584:12345-0@lo:502: Request processed in 202us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.944609:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787781813.944675:0:6823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44505ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.944696:0:6823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6823:1874625023715584:0@lo:502: 00000020:01000000:2.0:1787781813.944736:0:6823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781813.944745:0:6823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781813.944747:0:6823:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787781813.944755:0:6823:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef4450df800 00000020:00000080:2.0:1787781813.944757:0:6823:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787781813.944777:0:6823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6823:1874625023715712:0@lo:502: 00000100:00100000:2.0:1787781813.944824:0:6823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781813.944844:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023715712 00000100:00100000:2.0:1787781813.944848:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023715712 00000100:00100000:2.0:1787781813.944868:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787781813.944874:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:6823:x1874625023715712:12345-0@lo:502: 00000100:00100000:2.0:1787781813.944990:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:6823:x1874625023715712:12345-0@lo:502: Request processed in 116us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.944997:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787781813.945028:0:6823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44505ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.945735:0:6823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:6823:1874625023715712:0@lo:502: 00000020:01000000:3.0:1787781813.945911:0:6823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781813.945922:0:6823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781813.945924:0:6823:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787781813.945930:0:6823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787781813.945984:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787781813.945999:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781813.946008:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.946019:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781813.946036:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787781813.946038:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef450c2b370 from 1 10000000:01000000:3.0:1787781813.946041:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787781813.946066:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.946074:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.946082:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781813.946096:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023715840:0@lo:101: 00000100:00100000:3.0:1787781813.946134:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.946162:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963180 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.948374:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023715840 00000100:00100000:2.0:1787781813.948389:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023715840 00000100:00100000:2.0:1787781813.948450:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787781813.948478:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023715840:12345-0@lo:101: 00010000:00010000:2.0:1787781813.948496:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781813.948511:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453e9b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.948632:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453e9b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.948643:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e9b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.948652:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9a00, rc 0) 00000100:00100000:2.0:1787781813.948785:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023715840:12345-0@lo:101: Request processed in 316us (2650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781813.948806:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787781813.948846:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023715840:0@lo:101: 00010000:00010000:3.0:1787781813.948872:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781813.948882:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781813.948943:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023715968:0@lo:501: 00000100:00100000:3.0:1787781813.948978:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781813.949011:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963180 going to sleep for 11 seconds 00000100:00100000:2.0:1787781813.950067:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023715968 00000100:00100000:2.0:1787781813.950075:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023715968 00000100:00100000:2.0:1787781813.950116:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787781813.950124:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023715968:12345-0@lo:501: 00000100:00100000:2.0:1787781813.950369:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023715968:12345-0@lo:501: Request processed in 245us (1390us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787781813.950377:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787781813.950416:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023715968:0@lo:501: 10000000:01000000:2.0:1787781813.950444:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787781813.950453:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781813.950462:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781814.004264:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023716096:0@lo:13: 00000100:00100000:0.0:1787781814.004337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781814.004410:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023716096 00000100:00100000:0.0:1787781814.004417:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023716096 00000100:00100000:0.0:1787781814.004462:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781814.004470:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625023716096:12345-0@lo:13: 00002000:00000024:0.0:1787781814.004502:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787781814.004549:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625023716096:12345-0@lo:13: Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781814.004555:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787781814.004576:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787781814.004604:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44a716580 x1874625023716096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781814.004622:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023716096:0@lo:13: 00000004:00080000:0.0:1787781814.004643:0:6822:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787781814.004662:0:6822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6822:1874625023716224:0@lo:7: 00000100:00100000:0.0:1787781814.004698:0:6822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781814.004724:0:6822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445391180 going to sleep for 11 seconds 00000100:00100000:1.0:1787781814.011907:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023716224 00000100:00100000:1.0:1787781814.011921:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023716224 00000100:00100000:1.0:1787781814.011981:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781814.011990:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6822:x1874625023716224:12345-0@lo:7: 00002000:00080000:0.0:1787781814.030023:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787781814.030034:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787781814.030544:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6822:x1874625023716224:12345-0@lo:7: Request processed in 18550us (25839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781814.030560:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787781814.037574:0:6822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44a716580 x1874625023716224/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787781830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781814.037594:0:6822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6822:1874625023716224:0@lo:7: 00000004:00080000:1.0:1787781814.037608:0:6822:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787781814.037649:0:6822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6822:1874625023716352:0@lo:5: 00000100:00100000:1.0:1787781814.037717:0:6822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781814.037781:0:6822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4451053c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781814.041139:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023716352 00000100:00100000:3.0:1787781814.041157:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023716352 00000100:00100000:3.0:1787781814.041226:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787781814.043057:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6822:x1874625023716352:12345-0@lo:5: 00002000:00080000:3.0:1787781814.043102:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787781814.043107:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787781814.043477:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6822:x1874625023716352:12345-0@lo:5: Request processed in 2231us (5767us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787781814.043486:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787781814.043687:0:6822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44aa3d2c0 x1874625023716352/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781814.043705:0:6822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6822:1874625023716352:0@lo:5: 00000004:00080000:1.0:1787781814.043728:0:6822:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787781814.043767:0:6822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6822:1874625023716480:0@lo:700: 00000100:00100000:1.0:1787781814.043823:0:6822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781814.044002:0:6822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4451053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781814.047109:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023716480 00000100:00100000:0.0:1787781814.047126:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023716480 00000100:00100000:0.0:1787781814.047196:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781814.047207:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6822:x1874625023716480:12345-0@lo:700: 00000100:00100000:0.0:1787781814.047269:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1874625023716608:0@lo:700: 00000100:00100000:0.0:1787781814.047332:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781814.047364:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4450b8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787781814.047401:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023716608 00000100:00100000:0.0:1787781814.047405:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023716608 00000100:00100000:0.0:1787781814.047435:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781814.047443:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a715a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1874625023716608:12345-0@lo:700: 00000004:00080000:0.0:1787781814.058541:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787781814.131118:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787781814.136877:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a715a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1874625023716608:12345-0@lo:700: Request processed in 89426us (89536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781814.136890:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787781814.137260:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44a7152c0 x1874625023716608/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787781830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781814.137277:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1874625023716608:0@lo:700: 40000000:02000000:0.0:1787781814.137290:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1787781814.209681:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787781814.209699:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1787781814.209898:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6822:x1874625023716480:12345-0@lo:700: Request processed in 162689us (166070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781814.209910:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787781814.210101:0:6822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44aa3f840 x1874625023716480/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787781830 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781814.210113:0:6822:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787781814.210131:0:6822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6822:1874625023716480:0@lo:700: 00000004:02000040:0.0:1787781814.239914:0:6822:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787781814.243206:0:6822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6822:1874625023716736:0@lo:5: 00000100:00100000:0.0:1787781814.243277:0:6822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781814.243332:0:6822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4453910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781814.243396:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023716736 00000100:00100000:1.0:1787781814.243403:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023716736 00000100:00100000:1.0:1787781814.243456:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787781814.243464:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6822:x1874625023716736:12345-0@lo:5: 00002000:00080000:0.0:1787781814.254780:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787781814.254861:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787781814.258340:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6822:x1874625023716736:12345-0@lo:5: Request processed in 14870us (15055us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787781814.258351:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787781814.258425:0:6822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44a7152c0 x1874625023716736/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781830 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781814.258441:0:6822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6822:1874625023716736:0@lo:5: 00000004:00080000:1.0:1787781814.258455:0:6822:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787781814.462139:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781815.486229:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781816.517876:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781817.534642:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787781817.689430:0:7062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787781818.566500:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781819.070219:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781819.070244:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023716864:0@lo:13: 00000100:00100000:1.0:1787781819.070314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781819.070400:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023716864 00000100:00100000:1.0:1787781819.070407:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023716864 00000100:00100000:1.0:1787781819.070460:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781819.070469:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625023716864:12345-0@lo:13: 00002000:00000024:1.0:1787781819.070501:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781819.070545:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625023716864:12345-0@lo:13: Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781819.070551:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787781819.070571:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787781819.070601:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44aa3f840 x1874625023716864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781819.070619:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023716864:0@lo:13: 00000100:00100000:2.0:1787781819.073530:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023717120:0@lo:400: 00000100:00100000:2.0:1787781819.073617:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781819.073656:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781819.073673:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023716992:0@lo:400: 00000100:00100000:2.0:1787781819.073701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781819.073746:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023717120 00000100:00100000:2.0:1787781819.073752:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023717120 00000100:00100000:2.0:1787781819.073827:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787781819.073837:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef46205b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023717120:12345-0@lo:400: 00000100:00100000:2.0:1787781819.074112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef46205b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023717120:12345-0@lo:400: Request processed in 276us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781819.074119:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787781819.074143:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023716992 00000100:00100000:2.0:1787781819.074146:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023716992 00000100:00100000:2.0:1787781819.074211:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787781819.074219:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3304:x1874625023716992:12345-0@lo:400: 00000100:00100000:2.0:1787781819.074262:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3304:x1874625023716992:12345-0@lo:400: Request processed in 44us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781819.074269:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787781819.074710:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef46205b480 x1874625023717120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781819.074725:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023717120:0@lo:400: 00000100:00100000:3.0:1787781819.074749:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023716992:0@lo:400: 00000100:00100000:1.0:1787781819.075377:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023717248:0@lo:400: 00000100:00100000:1.0:1787781819.075435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781819.075486:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023717248 00000100:00100000:1.0:1787781819.075491:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023717248 00000100:00100000:1.0:1787781819.075531:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787781819.075539:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023717248:12345-0@lo:400: 00000100:00100000:1.0:1787781819.075582:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023717248:12345-0@lo:400: Request processed in 44us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781819.075589:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787781819.075612:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787781819.075636:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef462059e00 x1874625023717248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781819.075646:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023717248:0@lo:400: 00010000:00010000:2.0:1787781819.582174:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787781819.649930:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787781820.616937:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781821.630911:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781822.653947:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781823.678313:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781824.190005:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023717504:0@lo:400: 00000100:00100000:2.0:1787781824.190019:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023717760:0@lo:400: 00000100:00100000:3.0:1787781824.190028:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023717632:0@lo:400: 00000100:00100000:1.0:1787781824.190080:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023717376:0@lo:400: 00000100:00100000:2.0:1787781824.191876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781824.191921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781824.191973:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023717632 00000100:00100000:3.0:1787781824.191981:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023717632 00000100:00100000:3.0:1787781824.192056:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787781824.192065:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a760b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023717632:12345-0@lo:400: 00000100:00100000:3.0:1787781824.192118:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a760b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023717632:12345-0@lo:400: Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781824.192125:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787781824.192186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781824.192256:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023717376 00000100:00100000:1.0:1787781824.192260:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023717376 00000100:00100000:1.0:1787781824.192301:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787781824.192308:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3306:x1874625023717376:12345-0@lo:400: 00000100:00100000:1.0:1787781824.192340:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3306:x1874625023717376:12345-0@lo:400: Request processed in 33us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781824.192346:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787781824.192377:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023717888:0@lo:13: 00000100:00080000:3.0:1787781824.192404:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781824.192408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787781824.192443:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44a763c00 x1874625023717632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781824.192449:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023717376:0@lo:400: 00000100:00100000:3.0:1787781824.192463:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023717632:0@lo:400: 00000100:00100000:1.0:1787781824.192485:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023717888 00000100:00100000:1.0:1787781824.192490:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023717888 00000100:00100000:3.0:1787781824.192518:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023717760 00000100:00100000:3.0:1787781824.192523:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023717760 00000100:00100000:1.0:1787781824.192527:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787781824.192539:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625023717888:12345-0@lo:13: 00002000:00000024:1.0:1787781824.192566:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781824.192603:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625023717888:12345-0@lo:13: Request processed in 68us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781824.192609:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787781824.192661:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44aa3e1c0 x1874625023717888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781824.192671:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787781824.192686:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023717888:0@lo:13: 00000100:00100000:3.0:1787781824.194093:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787781824.194115:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462059a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023717760:12345-0@lo:400: 00000100:00100000:3.0:1787781824.194522:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462059a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023717760:12345-0@lo:400: Request processed in 417us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781824.194530:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787781824.194563:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787781824.194609:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44a762580 x1874625023717760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781824.194632:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023717760:0@lo:400: 00000100:00100000:0.0:1787781824.202207:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781824.202628:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023717504 00000100:00100000:2.0:1787781824.202636:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023717504 00000100:00100000:2.0:1787781824.202684:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787781824.202703:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023717504:12345-0@lo:400: 00000100:00100000:2.0:1787781824.202818:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023717504:12345-0@lo:400: Request processed in 117us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781824.202826:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787781824.204190:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44a7621c0 x1874625023717504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781824.204207:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023717504:0@lo:400: 00010000:00010000:3.0:1787781824.702266:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781825.729714:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781826.751954:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781827.777721:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787781827.789100:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787781827.789104:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787781827.789227:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ef444b97000 00000020:01000004:3.0:1787781827.789250:0:7636:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787781827.789262:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787781827.789275:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ef477bf4d28) 00000020:00000080:3.0:1787781827.789291:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787781827.807983:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787781827.808251:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787781827.837890:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787781827.851892:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787781827.854630:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787781827.854719:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787781827.854751:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787781827.856514:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787781827.856534:0:7636:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787781827.856550:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3ad9816c90453eb0 00000020:01000004:2.0:1787781827.856561:0:7636:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787781827.856599:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787781827.856604:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787781827.856612:0:7636:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787781827.856643:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787781827.856648:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787781827.896765:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787781827.896857:0:7636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.156@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787781827.896862:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787781827.896867:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787781827.896869:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781827.896871:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781827.896872:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781827.896873:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781827.896874:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781827.896876:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781827.896877:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781827.896879:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781827.896880:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781827.896885:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787781827.896887:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787781827.896888:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787781827.896889:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781827.896890:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787781827.896891:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781827.896893:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781827.896894:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781827.896895:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787781827.896896:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787781827.896897:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781827.896897:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787781827.897306:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787781827.897333:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a762580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023718016:0@lo:253: 00000100:00100000:3.0:1787781827.897437:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781827.897605:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787781827.898397:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023718016 00000100:00100000:0.0:1787781827.898410:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023718016 00000100:00100000:0.0:1787781827.898482:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787781827.898495:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:7636:x1874625023718016:12345-0@lo:253: 20000000:01000000:0.0:1787781827.898536:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787781827.898542:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787781827.898562:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787781827.898566:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787781827.900727:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787781827.901407:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787781827.901427:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787781827.901478:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787781827.901486:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787781827.901514:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787781827.901565:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787781827.902592:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787781827.902625:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:0.0:1787781827.902628:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:0.0:1787781827.902666:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787781827.902675:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787781827.902726:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787781827.902735:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:0.0:1787781827.902765:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787781827.902775:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787781827.902903:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787781827.903040:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787781827.904702:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787781827.904741:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:1.0:1787781827.904754:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:1.0:1787781827.904876:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787781827.904886:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787781827.905003:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787781827.905013:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:1.0:1787781827.905067:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787781827.905327:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787781827.905397:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787781827.905439:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787781827.905466:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787781827.905470:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787781827.905475:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787781827.905491:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787781827.905494:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787781827.905540:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787781827.905543:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787781827.914261:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787781827.914397:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787781827.914453:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787781827.918757:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787781827.920209:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787781827.920268:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787781827.920307:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787781827.920311:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787781827.925159:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787781827.925281:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787781827.925347:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787781827.926347:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787781827.927027:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787781827.927219:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1787781827.927256:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787781827.927259:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787781827.928111:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787781827.928453:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787781827.928479:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787781827.928524:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787781827.928543:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787781827.928546:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787781827.929189:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787781827.929234:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787781827.929264:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787781827.929443:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787781827.929479:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787781827.929510:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787781827.929531:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787781827.929532:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787781827.929543:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787781827.929570:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.929604:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453dfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453df3 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.929613:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e1d expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.929621:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e47 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.929628:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e63 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.929635:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e9b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.929644:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.929692:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453e9b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.929712:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453e9b expref: 16 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781827.929727:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718144:0@lo:104: 00000100:00100000:2.0:1787781827.930290:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781827.930389:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453e63 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.930412:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453e63 expref: 16 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781827.930423:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718272:0@lo:104: 00010000:00010000:2.0:1787781827.930470:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453e47 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.930479:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453e47 expref: 16 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781827.930487:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718400:0@lo:104: 00010000:00010000:2.0:1787781827.930512:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453e1d expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.930518:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453e1d expref: 16 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781827.930539:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4620592c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718528:0@lo:104: 00010000:00010000:2.0:1787781827.930562:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453df3 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.930580:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453dfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453df3 expref: 16 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781827.930600:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718656:0@lo:104: 00000100:00100000:2.0:1787781827.930622:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44506f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781827.936190:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787781827.936263:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781827.936397:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781827.937277:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781827.937362:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023718144 00000100:00100000:3.0:1787781827.937375:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023718144 00000100:00100000:3.0:1787781827.937432:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023718272 00000100:00100000:3.0:1787781827.937436:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023718272 00000100:00100000:3.0:1787781827.937447:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023718400 00000100:00100000:3.0:1787781827.937450:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023718400 00000100:00100000:3.0:1787781827.937464:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787781827.937474:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:5826:x1874625023718144:12345-0@lo:104: 00010000:00010000:3.0:1787781827.937497:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.937632:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787781827.937639:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:5826:x1874625023718144:12345-0@lo:104: Request processed in 168us (7353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781827.937647:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787781827.937705:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787781827.937713:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a716940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:5826:x1874625023718272:12345-0@lo:104: 00010000:00010000:3.0:1787781827.937721:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.937756:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787781827.937762:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a716940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:5826:x1874625023718272:12345-0@lo:104: Request processed in 51us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781827.937768:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787781827.937782:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781827.937808:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5826:x1874625023718400:12345-0@lo:104: 00010000:00010000:3.0:1787781827.937817:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.937845:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787781827.937851:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5826:x1874625023718400:12345-0@lo:104: Request processed in 63us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781827.937857:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787781827.937878:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787781827.937885:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.937893:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045c00 already unused, calling callback (ffffffffc1d18c20) 00000100:00100000:2.0:1787781827.938484:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718144:0@lo:104: 00000100:00100000:2.0:1787781827.938498:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718272:0@lo:104: 00000100:00100000:2.0:1787781827.938506:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718400:0@lo:104: 10000000:00010000:3.0:1787781827.938558:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938572:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781827.938581:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781827.938598:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781827.938653:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938660:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781827.938688:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938697:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90453e9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453ea2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938712:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787781827.938716:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938723:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044000 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:3.0:1787781827.938726:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938733:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781827.938754:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781827.938760:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781827.938775:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938781:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781827.938810:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938818:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453e63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938829:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781827.938833:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938839:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045600 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:3.0:1787781827.938842:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938848:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781827.938855:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781827.938860:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781827.938881:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.938887:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781827.939038:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.939047:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453e47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e4e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.939057:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781827.939059:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781827.939061:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781827.939069:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781827.939211:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023718912:0@lo:103: 00000100:00100000:3.0:1787781827.939278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781827.939380:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781827.939387:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023718784:0@lo:103: 00000100:00100000:3.0:1787781827.939428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781827.939507:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781827.939522:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023718528 00000100:00100000:0.0:1787781827.939529:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023718528 00000100:00100000:0.0:1787781827.939567:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023718656 00000100:00100000:0.0:1787781827.939576:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023718656 00000100:00100000:0.0:1787781827.939611:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781827.939619:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:5826:x1874625023718528:12345-0@lo:104: 00010000:00010000:0.0:1787781827.939630:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939684:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781827.939689:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:5826:x1874625023718528:12345-0@lo:104: Request processed in 72us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781827.939697:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781827.939712:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781827.939718:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5826:x1874625023718656:12345-0@lo:104: 00010000:00010000:0.0:1787781827.939726:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c90453df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939754:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781827.939759:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a717c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5826:x1874625023718656:12345-0@lo:104: Request processed in 42us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781827.939765:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787781827.939785:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787781827.939805:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939813:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8c00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787781827.939817:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939825:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781827.939843:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781827.939849:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781827.939875:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939882:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781827.939889:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939896:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453e1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e24 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939921:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781827.939925:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c90453df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939931:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441480a00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787781827.939934:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c90453df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939941:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c90453df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781827.939948:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c90453df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781827.939953:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781827.939974:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c90453df3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939981:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781827.939990:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c90453df3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.939997:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c90453df3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453dfa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.940014:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781827.940016:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781827.940018:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781827.940027:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023719296:0@lo:103: 00010000:00010000:0.0:1787781827.940062:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781827.940293:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4620592c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718528:0@lo:104: 00000100:00100000:0.0:1787781827.940304:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1874625023718656:0@lo:104: 00010000:00010000:0.0:1787781827.940348:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781827.940393:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023719168:0@lo:103: 00000100:00100000:0.0:1787781827.940451:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023719040:0@lo:103: 00000100:00100000:1.0:1787781827.940918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781827.941327:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023718912 00000100:00100000:2.0:1787781827.941336:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023718912 00010000:00010000:2.0:1787781827.941372:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e63 expref: 17 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781827.941411:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023718784 00000100:00100000:2.0:1787781827.941414:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023718784 00010000:00010000:2.0:1787781827.941427:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e9b expref: 18 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781827.941443:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787781827.941451:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef460d60780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:3304:x1874625023718912:12345-0@lo:103: 00010000:00010000:2.0:1787781827.941466:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781827.941472:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e63 expref: 18 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.941484:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453e63 expref: 18 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.941502:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453e6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453e63 expref: 18 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.941534:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781827.941593:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef460d60780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:3304:x1874625023718912:12345-0@lo:103: Request processed in 143us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781827.941601:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787781827.941618:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787781827.941624:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3304:x1874625023718784:12345-0@lo:103: 00010000:00010000:2.0:1787781827.941632:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781827.941636:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e9b expref: 16 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.941645:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453e9b expref: 16 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.941656:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b9a00/0x3ad9816c90453ea2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453e9b expref: 16 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781827.941664:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781827.941687:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:3304:x1874625023718784:12345-0@lo:103: Request processed in 63us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781827.941693:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787781827.942008:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023718784:0@lo:103: 00000100:00100000:2.0:1787781827.942019:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023718912:0@lo:103: 00000100:00100000:1.0:1787781827.942295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781827.942482:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781827.942541:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023719040 00000100:00100000:0.0:1787781827.942547:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023719040 00010000:00010000:0.0:1787781827.942575:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e47 expref: 15 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781827.942602:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023719168 00000100:00100000:0.0:1787781827.942605:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023719168 00010000:00010000:0.0:1787781827.942629:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e1d expref: 16 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781827.942642:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781827.942648:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3305:x1874625023719040:12345-0@lo:103: 00010000:00010000:0.0:1787781827.942658:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781827.942662:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e47 expref: 16 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.942672:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453e47 expref: 16 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.942685:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef441481400/0x3ad9816c90453e4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453e47 expref: 16 pid: 5827 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.942696:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781827.942740:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:3305:x1874625023719040:12345-0@lo:103: Request processed in 92us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781827.942747:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787781827.942761:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781827.942766:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:3306:x1874625023719168:12345-0@lo:103: 00010000:00010000:0.0:1787781827.942773:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781827.942778:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e1d expref: 14 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.942786:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453e1d expref: 14 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.942829:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453e24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453e1d expref: 14 pid: 5826 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.942849:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781827.942879:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:3306:x1874625023719168:12345-0@lo:103: Request processed in 112us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781827.942884:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781827.943416:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023719168:0@lo:103: 00000100:00100000:0.0:1787781827.943447:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023719040:0@lo:103: 00000100:00100000:2.0:1787781827.943604:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023719296 00000100:00100000:2.0:1787781827.943609:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023719296 00010000:00010000:2.0:1787781827.943635:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453dfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453df3 expref: 13 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781827.943681:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781827.943741:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:3303:x1874625023719296:12345-0@lo:103: 00010000:00010000:0.0:1787781827.943752:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781827.943757:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453dfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453df3 expref: 13 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943767:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453dfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453df3 expref: 13 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943780:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453dfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453df3 expref: 13 pid: 5825 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943822:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943833:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943851:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943858:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943872:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943879:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943886:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787781827.943890:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.943900:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.944030:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781827.944045:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781827.944241:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.944251:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781827.944259:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b9600/0x3ad9816c90453eb7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787781827.944276:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787781827.944357:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:3303:x1874625023719296:12345-0@lo:103: Request processed in 667us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781827.944367:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787781827.944967:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023719296:0@lo:103: 00000100:00100000:0.0:1787781828.085908:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:7636:x1874625023718016:12345-0@lo:253: Request processed in 187400us (188455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.085927:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787781828.086037:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a762580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023718016:0@lo:253: 10000000:01000000:3.0:1787781828.086059:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787781828.086063:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787781828.086065:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787781828.086067:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787781828.086068:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787781828.086070:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787781828.086071:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787781828.086073:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787781828.086075:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787781828.086076:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787781828.086078:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787781828.086107:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef444b97000 from lustre-OST0001 10000000:01000000:3.0:1787781828.086139:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787781828.086143:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787781828.086154:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ef450c2b370 local copy 10000000:01000000:3.0:1787781828.086160:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787781828.086214:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.086227:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.086240:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781828.086261:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023719424:0@lo:101: 00000100:00100000:3.0:1787781828.086303:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.086604:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe300 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.086688:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023719424 00000100:00100000:0.0:1787781828.086695:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023719424 00000100:00100000:0.0:1787781828.086818:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787781828.086830:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+11:7636:x1874625023719424:12345-0@lo:101: 00010000:00010000:0.0:1787781828.086846:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781828.086863:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453ec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453ebe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.086911:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453ebe expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.086923:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453ebe expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.086933:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031e00, rc 0) 00000100:00100000:0.0:1787781828.086981:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023719424:12345-0@lo:101: Request processed in 154us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.086989:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781828.087091:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023719424:0@lo:101: 00010000:00010000:3.0:1787781828.087106:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.087123:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781828.087268:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023719552:0@lo:501: 00000100:00100000:3.0:1787781828.087298:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.087613:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe300 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.087714:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023719552 00000100:00100000:1.0:1787781828.087721:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023719552 00000100:00100000:1.0:1787781828.087748:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787781828.087754:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023719552:12345-0@lo:501: 00000100:00100000:1.0:1787781828.088050:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023719552:12345-0@lo:501: Request processed in 295us (750us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787781828.088068:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787781828.088169:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023719552:0@lo:501: 10000000:01000000:3.0:1787781828.088187:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787781828.088220:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787781828.088228:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.088238:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.088247:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.088274:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787781828.088301:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef444b97000 10000000:01000000:3.0:1787781828.088307:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787781828.088312:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787781828.088315:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787781828.088319:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787781828.088323:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787781828.088358:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.088377:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.088388:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781828.088405:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023719680:0@lo:101: 00000100:00100000:3.0:1787781828.088599:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.088626:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787781828.088696:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781828.088704:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.088713:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045600 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787781828.088717:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.088727:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781828.088735:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781828.088742:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787781828.088766:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.088774:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781828.088823:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.088832:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482045600/0x3ad9816c90453ebe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3ad9816c90453ec5 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.088847:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781828.088849:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781828.088851:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781828.088861:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023719680 00000100:00100000:1.0:1787781828.088874:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023719680 00000100:00100000:1.0:1787781828.088900:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787781828.088907:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023719680:12345-0@lo:101: 00010000:00010000:1.0:1787781828.088919:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781828.088933:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453ecc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.088956:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453ecc expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.088968:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453ecc expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.088977:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef441480c00, rc 0) 00000100:00100000:1.0:1787781828.089011:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023719680:12345-0@lo:101: Request processed in 104us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.089017:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787781828.089094:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023719808:0@lo:103: 00000100:00100000:3.0:1787781828.089128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.089192:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023719680:0@lo:101: 00010000:00010000:3.0:1787781828.089203:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.089210:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781828.089292:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023719936:0@lo:501: 00000100:00100000:3.0:1787781828.089319:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.089332:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.089549:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023719936 00000100:00100000:1.0:1787781828.089554:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023719936 00000100:00100000:1.0:1787781828.089575:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787781828.089593:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023719936:12345-0@lo:501: 00000100:00100000:1.0:1787781828.089916:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023719936:12345-0@lo:501: Request processed in 333us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.089924:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787781828.089956:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023719808 00000100:00100000:1.0:1787781828.089960:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023719808 00000100:00100000:1.0:1787781828.089997:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787781828.090005:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a54f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:3304:x1874625023719808:12345-0@lo:103: 00010000:00010000:1.0:1787781828.090016:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781828.090042:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453ec5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90453ebe expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.090055:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781828.090083:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a54f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:3304:x1874625023719808:12345-0@lo:103: Request processed in 79us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.090090:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787781828.090228:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023719808:0@lo:103: 00000100:00100000:3.0:1787781828.090262:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023719936:0@lo:501: 00000100:00100000:3.0:1787781828.090299:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720064:0@lo:503: 00000100:00100000:3.0:1787781828.090361:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.090400:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.090605:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023720064 00000100:00100000:0.0:1787781828.090610:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023720064 00000100:00100000:0.0:1787781828.090640:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787781828.090648:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023720064:12345-0@lo:503: 00000100:00100000:0.0:1787781828.090862:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023720064:12345-0@lo:503: Request processed in 214us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.090870:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787781828.090965:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720064:0@lo:503: 00000040:00080000:3.0:1787781828.091306:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787781828.091392:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720192:0@lo:502: 00000100:00100000:3.0:1787781828.091535:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.091576:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.091679:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023720192 00000100:00100000:1.0:1787781828.091683:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023720192 00000100:00100000:1.0:1787781828.091711:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787781828.091719:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023720192:12345-0@lo:502: 00000100:00100000:1.0:1787781828.091932:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023720192:12345-0@lo:502: Request processed in 214us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.091940:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787781828.092078:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720192:0@lo:502: 00000040:00080000:3.0:1787781828.092421:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787781828.092644:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787781828.092685:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787781828.092742:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787781828.092783:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787781828.092874:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787781828.092916:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720320:0@lo:502: 00000100:00100000:3.0:1787781828.092978:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.093021:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.093128:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023720320 00000100:00100000:1.0:1787781828.093135:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023720320 00000100:00100000:1.0:1787781828.093174:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787781828.093183:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023720320:12345-0@lo:502: 00000100:00100000:1.0:1787781828.093763:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023720320:12345-0@lo:502: Request processed in 580us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.093773:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787781828.095735:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720320:0@lo:502: 00000040:00080000:3.0:1787781828.096292:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787781828.096313:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787781828.097697:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787781828.097712:0:7643:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787781828.097721:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781828.097724:0:7643:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787781828.097734:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787781828.097756:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ef477bf0000) 00000020:00000080:3.0:1787781828.097809:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787781828.097817:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787781828.098008:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef444b97000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787781828.098084:0:7643:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787781828.098099:0:7643:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3ad9816c90453ee1 00010000:00010000:3.0:1787781828.103221:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787781828.103738:0:7643:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787781828.117742:0:7643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787781828.118294:0:7643:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787781828.128576:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787781828.129291:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787781828.148616:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787781828.148636:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781828.148644:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781828.148647:0:7643:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787781828.148651:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781828.148656:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781828.148657:0:7643:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787781828.148660:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787781828.148663:0:7643:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787781828.148744:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781828.148748:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781828.148749:0:7643:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787781828.148753:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787781828.151043:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787781828.151113:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787781828.151146:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.151162:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781828.151172:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef444b97000 from 1 10000000:01000000:0.0:1787781828.151175:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787781828.151232:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.151242:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.151255:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.151286:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720448:0@lo:101: 00000100:00100000:0.0:1787781828.151375:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.151444:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801600 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.151479:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023720448 00000100:00100000:0.0:1787781828.151487:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023720448 00000100:00100000:0.0:1787781828.151542:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787781828.151552:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:7636:x1874625023720448:12345-0@lo:101: 00010000:00010000:0.0:1787781828.151569:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781828.151593:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453ee8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.151622:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453ee8 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.151636:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453ee8 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.151646:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031000, rc 0) 00000100:00100000:0.0:1787781828.151687:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023720448:12345-0@lo:101: Request processed in 136us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.151695:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787781828.151761:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720448:0@lo:101: 00010000:00010000:0.0:1787781828.151775:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.151786:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.153316:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720576:0@lo:501: 00000100:00100000:0.0:1787781828.153390:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.154657:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801600 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.169108:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023720576 00000100:00100000:1.0:1787781828.169131:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023720576 00000100:00100000:1.0:1787781828.169221:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787781828.169235:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023720576:12345-0@lo:501: 00000100:00100000:1.0:1787781828.169658:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023720576:12345-0@lo:501: Request processed in 425us (16266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.169667:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787781828.171631:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720576:0@lo:501: 00000100:00100000:0.0:1787781828.171713:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720704:0@lo:503: 00000100:00100000:0.0:1787781828.171841:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.171889:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801600 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.172232:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023720704 00000100:00100000:1.0:1787781828.172241:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023720704 00000100:00100000:1.0:1787781828.175839:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787781828.175875:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023720704:12345-0@lo:503: 00000100:00100000:1.0:1787781828.176484:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023720704:12345-0@lo:503: Request processed in 625us (4640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.176496:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787781828.177681:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720704:0@lo:503: 00000040:00080000:0.0:1787781828.180316:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787781828.180664:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720832:0@lo:502: 00000100:00100000:0.0:1787781828.181545:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.181647:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801600 going to sleep for 11 seconds 00000100:00100000:2.0:1787781828.190389:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023720832 00000100:00100000:2.0:1787781828.190416:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023720832 00000100:00100000:1.0:1787781828.191660:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787781828.191676:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023720832:12345-0@lo:502: 00000100:00100000:1.0:1787781828.193398:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023720832:12345-0@lo:502: Request processed in 1712us (11844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.193416:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787781828.196463:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720832:0@lo:502: 00000040:00080000:2.0:1787781828.196991:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787781828.197100:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787781828.197159:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720960:0@lo:502: 00000100:00100000:2.0:1787781828.197258:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781828.197312:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44506fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.198977:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023720960 00000100:00100000:1.0:1787781828.198996:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023720960 00000100:00100000:1.0:1787781828.199098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787781828.199110:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023720960:12345-0@lo:502: 00000100:00100000:1.0:1787781828.199451:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023720960:12345-0@lo:502: Request processed in 342us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.199460:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787781828.203056:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023720960:0@lo:502: 00000040:00080000:2.0:1787781828.203329:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787781828.203348:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787781828.209433:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781828.209455:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781828.209458:0:7647:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787781828.209467:0:7647:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef444b97000 00000020:00000080:1.0:1787781828.209471:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787781828.209496:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781828.209500:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781828.209501:0:7647:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787781828.209505:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787781828.210278:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787781828.210319:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787781828.210345:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781828.210362:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781828.210435:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787781828.210438:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef444b97000 10000000:01000000:2.0:1787781828.210442:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef444b97000 10000000:01000000:2.0:1787781828.210447:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787781828.210471:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef444b97000 from 1 10000000:01000000:2.0:1787781828.210475:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781828.210524:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781828.210534:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781828.210547:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781828.210577:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721088:0@lo:101: 00000100:00100000:2.0:1787781828.210678:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781828.210733:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44506f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781828.210833:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023721088 00000100:00100000:3.0:1787781828.210841:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023721088 00000100:00100000:3.0:1787781828.210896:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787781828.210908:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023721088:12345-0@lo:101: 00010000:00010000:3.0:1787781828.210925:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781828.210942:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453ef6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.210972:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453ef6 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.210986:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453ef6 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.210996:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482045c00, rc 0) 00000100:00100000:3.0:1787781828.211061:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023721088:12345-0@lo:101: Request processed in 156us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.211090:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787781828.211139:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721088:0@lo:101: 00010000:00010000:3.0:1787781828.211155:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781828.211164:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781828.211282:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721216:0@lo:501: 00000100:00100000:3.0:1787781828.211312:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.211338:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781828.211355:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023721216 00000100:00100000:3.0:1787781828.211359:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023721216 00000100:00100000:3.0:1787781828.211378:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787781828.211384:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023721216:12345-0@lo:501: 00000100:00100000:3.0:1787781828.211682:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023721216:12345-0@lo:501: Request processed in 296us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.211690:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787781828.211727:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721216:0@lo:501: 00000100:00100000:3.0:1787781828.211761:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721344:0@lo:503: 00000100:00100000:3.0:1787781828.211839:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.211853:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781828.211867:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023721344 00000100:00100000:3.0:1787781828.211871:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023721344 00000100:00100000:3.0:1787781828.211889:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787781828.211894:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023721344:12345-0@lo:503: 00000100:00100000:3.0:1787781828.212063:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023721344:12345-0@lo:503: Request processed in 168us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.212070:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787781828.212106:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721344:0@lo:503: 00000040:00080000:3.0:1787781828.212418:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787781828.212483:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721472:0@lo:502: 00000100:00100000:3.0:1787781828.212524:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.212540:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4489fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781828.212555:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023721472 00000100:00100000:3.0:1787781828.212559:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023721472 00000100:00100000:3.0:1787781828.212592:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787781828.212599:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023721472:12345-0@lo:502: 00000100:00100000:3.0:1787781828.212771:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023721472:12345-0@lo:502: Request processed in 172us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.212777:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787781828.212843:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721472:0@lo:502: 00000040:00080000:3.0:1787781828.213116:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787781828.213164:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787781828.213199:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787781828.213263:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787781828.213308:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787781828.213356:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787781828.213390:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787781828.213419:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787781828.213463:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787781828.213495:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787781828.213528:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787781828.213599:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787781828.213636:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787781828.213694:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787781828.213747:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787781828.213785:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787781828.213849:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787781828.213898:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787781828.213930:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787781828.213965:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787781828.214025:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787781828.214056:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787781828.214084:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787781828.214125:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787781828.214157:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787781828.214188:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787781828.214234:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787781828.214270:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787781828.214304:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787781828.214364:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787781828.214406:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787781828.214443:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787781828.214476:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787781828.214525:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787781828.214562:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787781828.222501:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787781828.222626:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787781828.222701:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721600:0@lo:502: 00000100:00100000:3.0:1787781828.223639:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.223713:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448d43b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787781828.226639:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023721600 00000100:00100000:0.0:1787781828.226658:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023721600 00000100:00100000:0.0:1787781828.226747:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787781828.226760:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023721600:12345-0@lo:502: 00000100:00100000:0.0:1787781828.227250:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023721600:12345-0@lo:502: Request processed in 491us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.227260:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787781828.227445:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023721600:0@lo:502: 00000040:00080000:3.0:1787781828.227618:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787781828.227650:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787781828.230210:0:7648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787781828.230310:0:7648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ef477bf3370) 00000020:00000080:3.0:1787781828.230499:0:7648:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787781828.230617:0:7648:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef444b97000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787781828.230623:0:7648:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef444b97000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787781828.230627:0:7648:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef444b97000 3 00010000:00080000:3.0:1787781828.230668:0:7648:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef47f9f3000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.156@tcp at head 00010000:00010000:3.0:1787781828.233195:0:7648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787781828.233482:0:7648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787781828.233531:0:7648:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787781828.233549:0:7648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3ad9816c90453f0b 00000100:00080000:3.0:1787781828.233563:0:7648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787781828.233572:0:7648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ef47f9f3000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1787781828.240061:0:7648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef478a56d00 x1874625023721728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787781828.240096:0:7648:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787781828.240282:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874625023721728:0@lo:38: 00000100:00100000:2.0:1787781828.240392:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781828.242342:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023721856:0@lo:400: 00000100:00100000:2.0:1787781828.242434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.242551:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023721728 00000100:00100000:3.0:1787781828.242561:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023721728 00000100:00100000:3.0:1787781828.242619:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023721856 00000100:00100000:3.0:1787781828.242623:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023721856 00000100:00100000:3.0:1787781828.242656:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781828.242665:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462059680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023721856:12345-0@lo:400: 00000100:00100000:3.0:1787781828.246836:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462059680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023721856:12345-0@lo:400: Request processed in 4155us (4386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.246857:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781828.246923:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787781828.246933:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef46205b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874625023721728:12345-0@lo:38: 00010000:00080000:3.0:1787781828.247007:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1787781828.247083:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3ad9816c90453f12 00000004:00100000:3.0:1787781828.247109:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787781828.247157:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9ef47f9f2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781828.247288:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef46205b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874625023721728:12345-0@lo:38: Request processed in 354us (6895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.247295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787781828.247365:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023722112:0@lo:400: 00000100:00100000:3.0:1787781828.247413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781828.247992:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023722112 00000100:00100000:3.0:1787781828.248003:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023722112 00000100:00100000:3.0:1787781828.248065:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787781828.248074:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023722112:12345-0@lo:400: 00000100:00100000:3.0:1787781828.248128:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023722112:12345-0@lo:400: Request processed in 56us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.248136:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787781828.248154:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787781828.248192:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef480a05680 x1874625023722112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781828.248208:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023722112:0@lo:400: 00000100:00100000:0.0:1787781828.248391:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625023721984:0@lo:400: 00000100:00100000:0.0:1787781828.248463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787781828.250885:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef478a56d00 x1874625023721728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787781838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781828.250912:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787781828.250926:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787781828.250939:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787781828.250945:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787781828.250949:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef47f9f3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787781828.250957:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874625023721728:0@lo:38: 00000100:00100000:3.0:1787781828.251559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023721984 00000100:00100000:3.0:1787781828.251571:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023721984 00000100:00100000:3.0:1787781828.251670:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787781828.251682:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625023721984:12345-0@lo:400: 00000100:00100000:3.0:1787781828.251817:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625023721984:12345-0@lo:400: Request processed in 137us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781828.251826:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787781828.251898:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef480a04000 x1874625023721984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781828.252023:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625023721984:0@lo:400: 00010000:00080000:2.0:1787781828.252280:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef44aa3da40 x1874625023721856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781828.252293:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023721856:0@lo:400: 00000040:00080000:3.0:1787781828.252310:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1787781828.252407:0:7650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7650:1874625023722240:0@lo:901: 00000100:00100000:2.0:1787781828.252456:0:7650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781828.252493:0:7650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44506ff00 going to sleep for 11 seconds 00000020:01000000:2.0:1787781828.252519:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787781828.252551:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787781828.252566:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781828.252612:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787781828.252646:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:2.0:1787781828.252675:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787781828.252677:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787781828.252678:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781828.252679:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781828.252680:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781828.252681:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781828.252683:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787781828.252684:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781828.252686:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781828.252687:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781828.252688:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787781828.252692:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787781828.252694:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787781828.252695:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787781828.252695:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787781828.252696:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787781828.252696:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787781828.252697:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787781828.252698:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787781828.252699:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787781828.252699:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787781828.252700:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787781828.252701:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787781828.252715:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787781828.252721:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023722368:0@lo:253: 00000100:00100000:2.0:1787781828.252755:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781828.252786:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44506fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781828.252818:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023722368 00000100:00100000:3.0:1787781828.252823:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023722368 00000100:00100000:3.0:1787781828.252865:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787781828.252875:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7636:x1874625023722368:12345-0@lo:253: 00000100:00100000:1.0:1787781828.252894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023722240 00000100:00100000:1.0:1787781828.252898:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023722240 20000000:01000000:3.0:1787781828.252900:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1787781828.252935:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787781828.252942:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4620592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7650:x1874625023722240:12345-0@lo:901: 00000100:00080000:0.0:1787781828.253000:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1787781828.253058:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787781828.253416:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4620592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7650:x1874625023722240:12345-0@lo:901: Request processed in 474us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.253425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787781828.253526:0:7650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef462059e00 x1874625023722240/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787781844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781828.253538:0:7650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7650:1874625023722240:0@lo:901: 20000000:01000000:0.0:1787781828.323371:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787781828.323396:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787781828.323517:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787781828.323524:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787781828.323556:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781828.323616:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e55 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781828.323626:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781828.323685:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453e55 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781828.323720:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453e55 expref: 14 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781828.323738:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205b0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874625023722496:0@lo:104: 00000100:00100000:2.0:1787781828.323869:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781828.323942:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44506fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781828.324026:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023722496 00000100:00100000:1.0:1787781828.324036:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023722496 00000100:00100000:1.0:1787781828.324107:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787781828.324119:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4620583c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5849:x1874625023722496:12345-0@lo:104: 00010000:00010000:1.0:1787781828.324135:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.324204:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787781828.324212:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4620583c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:5849:x1874625023722496:12345-0@lo:104: Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.324219:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787781828.324268:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205b0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874625023722496:0@lo:104: 00010000:00010000:1.0:1787781828.324302:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.324952:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781828.324963:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.324972:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8400 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787781828.324976:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.324987:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781828.324995:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781828.325001:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781828.325169:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.325177:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781828.325212:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.325235:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453e55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.325256:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781828.325258:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781828.325259:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781828.325312:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781828.325331:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023722624:0@lo:103: 00000100:00100000:1.0:1787781828.325415:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781828.326144:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023722624 00000100:00100000:0.0:1787781828.326154:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023722624 00010000:00010000:0.0:1787781828.326193:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e55 expref: 15 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.326333:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787781828.326351:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450ca8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:3303:x1874625023722624:12345-0@lo:103: 00010000:00010000:0.0:1787781828.326369:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781828.326376:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e55 expref: 15 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326390:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453e55 expref: 15 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326408:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453e5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453e55 expref: 15 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326436:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326446:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787781828.326480:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003244285s 00010000:00010000:0.0:1787781828.326486:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326494:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326502:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326510:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326517:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787781828.326522:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326532:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326554:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781828.326564:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781828.326640:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450ca8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:3303:x1874625023722624:12345-0@lo:103: Request processed in 298us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781828.326649:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787781828.326759:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.326770:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781828.326777:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f19 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781828.331738:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023722624:0@lo:103: 00000100:00100000:1.0:1787781828.340880:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:7636:x1874625023722368:12345-0@lo:253: Request processed in 87991us (88107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781828.340900:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787781828.341098:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9f3bcc54-cf30-454f-ba67-121e6963b1be:7636:1874625023722368:0@lo:253: 10000000:01000000:0.0:1787781828.341137:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787781828.341141:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787781828.341143:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787781828.341145:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787781828.341146:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787781828.341147:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787781828.341148:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787781828.341150:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787781828.341152:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787781828.341154:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787781828.341156:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787781828.341158:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787781828.341180:0:7636:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787781828.348327:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787781828.349234:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787781828.349681:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787781828.355466:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787781828.356091:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787781828.356370:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787781828.359688:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787781828.543864:0:7636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787781828.543873:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787781828.543911:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787781828.543970:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787781828.543989:0:7636:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787781828.544022:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787781828.798426:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781829.315748:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023722752:0@lo:13: 00000100:00100000:3.0:1787781829.315920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781829.316088:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023722752 00000100:00100000:2.0:1787781829.316100:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023722752 00000100:00100000:2.0:1787781829.316165:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787781829.316177:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023722752:12345-0@lo:13: 00002000:00000024:2.0:1787781829.316226:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781829.316287:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023722752:12345-0@lo:13: Request processed in 113us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781829.316295:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787781829.316351:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef462058780 x1874625023722752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781829.316398:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023722752:0@lo:13: 00010000:00010000:0.0:1787781829.825940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781830.849196:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781831.870097:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781832.895155:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781833.407274:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023723008:0@lo:400: 00000100:00100000:0.0:1787781833.407369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.407437:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781833.407442:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023723136:0@lo:400: 00000100:00100000:0.0:1787781833.407463:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.407498:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023723008 00000100:00100000:0.0:1787781833.407507:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023723008 00000100:00100000:0.0:1787781833.407566:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023723136 00000100:00100000:0.0:1787781833.407569:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023723136 00000100:00100000:0.0:1787781833.407595:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781833.407605:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023723008:12345-0@lo:400: 00000100:00100000:0.0:1787781833.407666:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023723008:12345-0@lo:400: Request processed in 62us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.407686:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781833.407720:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787781833.407727:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023723136:12345-0@lo:400: 00000100:00100000:0.0:1787781833.407756:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023723136:12345-0@lo:400: Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.407762:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787781833.407783:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1787781833.408340:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787781833.408347:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef450a67000 from 30 10000000:01000000:2.0:1787781833.408353:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781833.408397:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.408410:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.408424:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781833.408445:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023723520:0@lo:101: 00000100:00100000:2.0:1787781833.408491:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.408527:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787781833.409224:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023722880:0@lo:400: 00000100:00100000:1.0:1787781833.409270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.409298:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023723392:0@lo:400: 00000100:00100000:1.0:1787781833.409321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.409349:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781833.409356:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023723264:0@lo:400: 00000100:00100000:1.0:1787781833.409382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.410055:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023723392 00000100:00100000:2.0:1787781833.410068:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023723392 00000100:00100000:2.0:1787781833.410223:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787781833.410234:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023723392:12345-0@lo:400: 00000100:00100000:2.0:1787781833.410313:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023723392:12345-0@lo:400: Request processed in 81us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.410320:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787781833.410352:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023723520 00000100:00100000:2.0:1787781833.410356:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023723520 00000100:00100000:2.0:1787781833.410379:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023722880 00000100:00100000:2.0:1787781833.410390:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023722880 00000100:00100000:2.0:1787781833.410403:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787781833.410408:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023723520:12345-0@lo:101: 00010000:00010000:2.0:1787781833.410420:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781833.410439:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453f20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.410467:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453f20 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.410478:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f20 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.410490:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8e00, rc 0) 00000100:00100000:2.0:1787781833.410518:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023723520:12345-0@lo:101: Request processed in 110us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.410524:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1787781833.410735:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a04b40 x1874625023723136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781833.410752:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023723136:0@lo:400: 00010000:00080000:0.0:1787781833.410775:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a05a40 x1874625023723008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781833.410784:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023723008:0@lo:400: 00000100:00100000:3.0:1787781833.411489:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023723264 00000100:00100000:3.0:1787781833.411499:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023723264 00000100:00100000:3.0:1787781833.411558:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787781833.411568:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023723264:12345-0@lo:400: 00000100:00100000:3.0:1787781833.411627:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023723264:12345-0@lo:400: Request processed in 61us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781833.411634:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787781833.411774:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a052c0 x1874625023723264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781833.411813:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023723264:0@lo:400: 00010000:00080000:3.0:1787781833.411848:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a07c00 x1874625023723392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781833.411857:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023723392:0@lo:400: 00000100:00100000:0.0:1787781833.412072:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787781833.412082:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:3306:x1874625023722880:12345-0@lo:400: 00000100:00100000:0.0:1787781833.412123:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:3306:x1874625023722880:12345-0@lo:400: Request processed in 44us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.412129:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787781833.412311:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023722880:0@lo:400: 00000100:00080000:3.0:1787781833.412340:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787781833.412346:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781833.414573:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023723520:0@lo:101: 00010000:00010000:3.0:1787781833.414614:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781833.414630:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781833.414727:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023723648:0@lo:501: 00000100:00100000:3.0:1787781833.414994:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.415100:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023723648 00000100:00100000:0.0:1787781833.415109:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023723648 00000100:00100000:3.0:1787781833.417018:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f3b1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781833.418567:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787781833.418595:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023723648:12345-0@lo:501: 00000100:00100000:0.0:1787781833.420218:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023723648:12345-0@lo:501: Request processed in 1627us (5213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.420244:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787781833.421050:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023723648:0@lo:501: 00000100:00100000:3.0:1787781833.421124:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023723776:0@lo:503: 00000100:00100000:3.0:1787781833.421201:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781833.425578:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f3b1540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781833.425627:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023723776 00000100:00100000:1.0:1787781833.425638:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023723776 00000100:00100000:1.0:1787781833.425700:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787781833.425720:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023723776:12345-0@lo:503: 00000100:00100000:1.0:1787781833.428634:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023723776:12345-0@lo:503: Request processed in 2900us (7418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781833.428652:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787781833.428777:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023723776:0@lo:503: 00000100:00100000:1.0:1787781833.430333:0:7867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7867:1874625023723904:0@lo:502: 00000100:00100000:1.0:1787781833.431122:0:7867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.431297:0:7867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781833.432260:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023723904 00000100:00100000:3.0:1787781833.432274:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023723904 00000100:00100000:0.0:1787781833.436099:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787781833.436129:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7867:x1874625023723904:12345-0@lo:502: 00000100:00100000:0.0:1787781833.437723:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7867:x1874625023723904:12345-0@lo:502: Request processed in 1598us (6595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.437739:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787781833.439834:0:7867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7867:1874625023723904:0@lo:502: 00000100:00100000:2.0:1787781833.440125:0:7867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7867:1874625023724032:0@lo:502: 00000100:00100000:2.0:1787781833.440285:0:7867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.440387:0:7867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781833.442713:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023724032 00000100:00100000:0.0:1787781833.442734:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023724032 00000100:00100000:0.0:1787781833.443279:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787781833.443292:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7867:x1874625023724032:12345-0@lo:502: 00000100:00100000:0.0:1787781833.446009:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:7867:x1874625023724032:12345-0@lo:502: Request processed in 2705us (5710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.446026:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787781833.446767:0:7867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7867:1874625023724032:0@lo:502: 00000040:00080000:3.0:1787781833.446845:0:7867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787781833.448367:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787781833.448548:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787781833.448565:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781833.448581:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781833.448595:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787781833.448599:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787781833.448602:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787781833.448660:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781833.448670:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781833.448682:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781833.448712:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724160:0@lo:101: 00000100:00100000:1.0:1787781833.448845:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.448923:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.451321:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023724160 00000100:00100000:2.0:1787781833.451342:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023724160 00000100:00100000:2.0:1787781833.451740:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787781833.451753:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023724160:12345-0@lo:101: 00010000:00010000:2.0:1787781833.451778:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781833.451822:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453f2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.451873:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453f2e expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.453053:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f2e expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.453072:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8600, rc 0) 00000100:00100000:2.0:1787781833.453230:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023724160:12345-0@lo:101: Request processed in 1477us (4386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.453241:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787781833.453316:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724160:0@lo:101: 00010000:00010000:2.0:1787781833.453344:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.453357:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781833.453453:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724288:0@lo:501: 00000100:00100000:2.0:1787781833.453497:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.455330:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.455374:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023724288 00000100:00100000:2.0:1787781833.455386:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023724288 00000100:00100000:2.0:1787781833.455457:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787781833.455468:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023724288:12345-0@lo:501: 00000100:00100000:2.0:1787781833.456040:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023724288:12345-0@lo:501: Request processed in 571us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.456050:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787781833.456227:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724288:0@lo:501: 00000100:00100000:2.0:1787781833.456290:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724416:0@lo:503: 00000100:00100000:2.0:1787781833.456352:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781833.462702:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023724416 00000100:00100000:3.0:1787781833.462733:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023724416 00000100:00100000:3.0:1787781833.462830:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787781833.462842:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023724416:12345-0@lo:503: 00000100:00100000:3.0:1787781833.463305:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023724416:12345-0@lo:503: Request processed in 464us (6951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781833.463315:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787781833.471360:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.471431:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724416:0@lo:503: 00000100:00100000:0.0:1787781833.484229:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7876:1874625023724544:0@lo:502: 00000100:00100000:0.0:1787781833.484351:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.484426:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4450b8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.485449:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023724544 00000100:00100000:2.0:1787781833.485465:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023724544 00000100:00100000:2.0:1787781833.485547:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787781833.485559:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:7876:x1874625023724544:12345-0@lo:502: 00000100:00100000:2.0:1787781833.486186:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:7876:x1874625023724544:12345-0@lo:502: Request processed in 627us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.486196:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787781833.486586:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7876:1874625023724544:0@lo:502: 00000020:01000000:0.0:1787781833.486638:0:7876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781833.486649:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781833.486652:0:7876:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787781833.486658:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787781833.486660:0:7876:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787781833.486692:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7876:1874625023724672:0@lo:502: 00000100:00100000:0.0:1787781833.486744:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.486807:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4450b8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.487228:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023724672 00000100:00100000:2.0:1787781833.487236:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023724672 00000100:00100000:2.0:1787781833.487281:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787781833.487290:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:7876:x1874625023724672:12345-0@lo:502: 00000100:00100000:2.0:1787781833.487504:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:7876:x1874625023724672:12345-0@lo:502: Request processed in 215us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.487512:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787781833.488219:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7876:1874625023724672:0@lo:502: 00000020:01000000:0.0:1787781833.488276:0:7876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787781833.488283:0:7876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781833.488285:0:7876:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787781833.488289:0:7876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787781833.489685:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787781833.489726:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787781833.489740:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.489755:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781833.489784:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787781833.489819:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef4450df800 from 30 10000000:01000000:2.0:1787781833.489822:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781833.489870:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.491131:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.491150:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781833.491181:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724800:0@lo:101: 00000100:00100000:2.0:1787781833.491279:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.491330:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.491377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023724800 00000100:00100000:2.0:1787781833.491385:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023724800 00000100:00100000:2.0:1787781833.491444:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787781833.491456:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023724800:12345-0@lo:101: 00010000:00010000:2.0:1787781833.491474:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781833.491495:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453f3c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.491525:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453f3c expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.491550:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f3c expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.491576:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8a00, rc 0) 00000100:00100000:2.0:1787781833.491618:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023724800:12345-0@lo:101: Request processed in 164us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.491625:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787781833.491685:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724800:0@lo:101: 00010000:00010000:2.0:1787781833.491700:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.491710:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781833.491779:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724928:0@lo:501: 00000100:00100000:2.0:1787781833.491844:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.491866:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.494128:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023724928 00000100:00100000:2.0:1787781833.494146:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023724928 00000100:00100000:2.0:1787781833.494214:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787781833.494226:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023724928:12345-0@lo:501: 00000100:00100000:2.0:1787781833.494650:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023724928:12345-0@lo:501: Request processed in 425us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.494659:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787781833.494751:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023724928:0@lo:501: 00000100:00100000:2.0:1787781833.494852:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725056:0@lo:503: 00000100:00100000:2.0:1787781833.498092:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.498157:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.498214:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023725056 00000100:00100000:2.0:1787781833.498225:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023725056 00000100:00100000:2.0:1787781833.499030:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787781833.499411:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023725056:12345-0@lo:503: 00000100:00100000:2.0:1787781833.500100:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023725056:12345-0@lo:503: Request processed in 690us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.500111:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787781833.500124:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725056:0@lo:503: 00000100:00100000:1.0:1787781833.502287:0:7877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7877:1874625023725184:0@lo:502: 00000100:00100000:1.0:1787781833.502986:0:7877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.503036:0:7877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998840 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.504188:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023725184 00000100:00100000:2.0:1787781833.504205:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023725184 00000100:00100000:2.0:1787781833.504292:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787781833.504306:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:7877:x1874625023725184:12345-0@lo:502: 00000100:00100000:2.0:1787781833.504716:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:7877:x1874625023725184:12345-0@lo:502: Request processed in 411us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.504725:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787781833.505356:0:7877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7877:1874625023725184:0@lo:502: 00000100:00100000:1.0:1787781833.505442:0:7877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7877:1874625023725312:0@lo:502: 00000100:00100000:1.0:1787781833.505489:0:7877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.505529:0:7877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998840 going to sleep for 11 seconds 00000100:00100000:3.0:1787781833.507943:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023725312 00000100:00100000:3.0:1787781833.507962:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023725312 00000100:00100000:3.0:1787781833.508037:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787781833.508051:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:7877:x1874625023725312:12345-0@lo:502: 00000100:00100000:3.0:1787781833.508406:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:7877:x1874625023725312:12345-0@lo:502: Request processed in 359us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781833.508414:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787781833.508606:0:7877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7877:1874625023725312:0@lo:502: 00000040:00080000:1.0:1787781833.508654:0:7877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787781833.508906:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787781833.508933:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787781833.508947:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.508961:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781833.508973:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787781833.508976:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef4450df800 from 5 10000000:01000000:2.0:1787781833.508979:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787781833.509021:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.509030:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.509051:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781833.509074:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725440:0@lo:101: 00000100:00100000:2.0:1787781833.509127:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.509170:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781833.509336:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023725440 00000100:00100000:3.0:1787781833.509342:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023725440 00000100:00100000:3.0:1787781833.509422:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787781833.509431:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023725440:12345-0@lo:101: 00010000:00010000:3.0:1787781833.509444:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781833.509461:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482045800/0x3ad9816c90453f51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453f4a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781833.509489:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482045800/0x3ad9816c90453f51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453f4a expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781833.509501:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482045800/0x3ad9816c90453f51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f4a expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781833.509511:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482045800, rc 0) 00000100:00100000:3.0:1787781833.509558:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023725440:12345-0@lo:101: Request processed in 129us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781833.509573:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787781833.510314:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725440:0@lo:101: 00010000:00010000:2.0:1787781833.510334:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.510345:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781833.510402:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725568:0@lo:256: 00000100:00100000:2.0:1787781833.510446:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.510477:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.510493:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023725568 00000100:00100000:2.0:1787781833.510498:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023725568 00000100:00100000:2.0:1787781833.510550:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787781833.510559:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023725568:12345-0@lo:256: 20000000:01000000:2.0:1787781833.510578:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787781833.510599:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787781833.510602:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787781833.510688:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023725568:12345-0@lo:256: Request processed in 130us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.510696:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787781833.510738:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725568:0@lo:256: 10000000:01000000:2.0:1787781833.514952:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787781833.514981:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.514997:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781833.515010:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787781833.515014:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787781833.515017:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787781833.515077:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.515086:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.515098:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781833.515129:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725696:0@lo:101: 00000100:00100000:2.0:1787781833.515220:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.515272:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.515303:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023725696 00000100:00100000:2.0:1787781833.515312:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023725696 00000100:00100000:2.0:1787781833.515375:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787781833.515385:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023725696:12345-0@lo:101: 00010000:00010000:2.0:1787781833.515401:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781833.515415:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453f58 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.515462:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453f58 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.515474:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f58 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.515483:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8000, rc 0) 00000100:00100000:2.0:1787781833.515526:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023725696:12345-0@lo:101: Request processed in 141us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.515545:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787781833.515607:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725696:0@lo:101: 00010000:00010000:2.0:1787781833.515622:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781833.515632:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781833.515690:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725824:0@lo:501: 00000100:00100000:2.0:1787781833.515719:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.515734:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.515746:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023725824 00000100:00100000:2.0:1787781833.515750:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023725824 00000100:00100000:2.0:1787781833.515779:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787781833.519782:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023725824:12345-0@lo:501: 00000100:00100000:2.0:1787781833.520530:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023725824:12345-0@lo:501: Request processed in 4739us (4806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781833.520552:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787781833.521173:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725824:0@lo:501: 00000100:00100000:0.0:1787781833.521251:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725952:0@lo:503: 00000100:00100000:0.0:1787781833.521319:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.521369:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4450b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787781833.521995:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023725952 00000100:00100000:3.0:1787781833.522005:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023725952 00000100:00100000:3.0:1787781833.522064:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787781833.522074:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023725952:12345-0@lo:503: 00000100:00100000:3.0:1787781833.522399:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023725952:12345-0@lo:503: Request processed in 324us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781833.522407:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787781833.522555:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023725952:0@lo:503: 00000100:00100000:3.0:1787781833.536315:0:7878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7878:1874625023726080:0@lo:502: 00000100:00100000:3.0:1787781833.536436:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781833.536495:0:7878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f3b1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787781833.536595:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023726080 00000100:00100000:0.0:1787781833.536605:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023726080 00000100:00100000:0.0:1787781833.536665:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787781833.536677:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:7878:x1874625023726080:12345-0@lo:502: 00000100:00100000:0.0:1787781833.537135:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:7878:x1874625023726080:12345-0@lo:502: Request processed in 458us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.537144:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787781833.537311:0:7878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7878:1874625023726080:0@lo:502: 00000020:01000000:1.0:1787781833.537360:0:7878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787781833.537370:0:7878:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787781833.537379:0:7878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781833.537382:0:7878:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787781833.537388:0:7878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787781833.537393:0:7878:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:1.0:1787781833.537423:0:7878:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787781833.537427:0:7878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787781833.537447:0:7878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ef476f319b8) 00000020:00000080:1.0:1787781833.537476:0:7878:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787781833.537483:0:7878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787781833.537608:0:7878:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787781833.537618:0:7878:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787781833.537635:0:7878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90453f6d 00010000:00080000:1.0:1787781833.537677:0:7878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef444b95000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1787781833.540061:0:7878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787781833.542611:0:7878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787781833.542636:0:7878:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787781833.543304:0:7878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781833.543526:0:7878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781833.543602:0:7878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787781833.543693:0:7878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787781833.552769:0:7884:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787781833.552782:0:7884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787781833.555721:0:7878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787781833.555744:0:7878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787781833.555817:0:7878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787781833.555849:0:7878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c90453f74 00000100:00080000:1.0:1787781833.555862:0:7878:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787781833.555869:0:7878:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef444b95000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1787781833.555919:0:7878:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef480a070c0 x1874625023726208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787781833.555948:0:7878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787781833.556000:0:7878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781833.556005:0:7878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781833.556007:0:7878:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787781833.556011:0:7878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781833.556015:0:7878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781833.556017:0:7878:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787781833.556020:0:7878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787781833.556022:0:7878:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787781833.556056:0:7878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7878:1874625023726336:0@lo:502: 00000100:00100000:1.0:1787781833.556173:0:7878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.556228:0:7878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781833.556251:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023726208:0@lo:8: 00000100:00100000:1.0:1787781833.556303:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781833.556364:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023726208 00000100:00100000:1.0:1787781833.556372:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023726208 00000100:00100000:1.0:1787781833.556428:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787781833.556438:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1874625023726208:12345-0@lo:8: 00010000:00080000:1.0:1787781833.556466:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1787781833.556492:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c90453f7b 00002000:00100000:1.0:1787781833.556508:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ef34317c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787781833.556513:0:6695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787781833.556517:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787781833.556634:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023726336 00000100:00100000:0.0:1787781833.556640:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023726336 00000100:00100000:0.0:1787781833.556687:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00002000:00100000:1.0:1787781833.556697:0:6695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787781833.556697:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:7878:x1874625023726336:12345-0@lo:502: 00002000:00080000:1.0:1787781833.556895:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787781833.556924:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ef34317f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787781833.556980:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874625023726208:12345-0@lo:8: Request processed in 542us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781833.556988:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787781833.557032:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a070c0 x1874625023726208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787781843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781833.557043:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787781833.557053:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787781833.557062:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787781833.557067:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787781833.557069:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef444b95000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787781833.557074:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787781833.557079:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023726208:0@lo:8: 00000100:00100000:0.0:1787781833.557415:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:7878:x1874625023726336:12345-0@lo:502: Request processed in 720us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.557424:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787781833.558077:0:7878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:7878:1874625023726336:0@lo:502: 00000020:01000000:1.0:1787781833.558114:0:7878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781833.558121:0:7878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781833.558123:0:7878:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787781833.558128:0:7878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787781833.558232:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787781833.558261:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787781833.558279:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781833.558293:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781833.558305:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787781833.558308:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef450c2b370 from 1 10000000:01000000:0.0:1787781833.558311:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787781833.558349:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781833.558358:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781833.558368:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781833.558388:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023726464:0@lo:101: 00000100:00100000:0.0:1787781833.558436:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.558475:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4450b8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787781833.558495:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023726464 00000100:00100000:0.0:1787781833.558500:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023726464 00000100:00100000:0.0:1787781833.558547:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787781833.558558:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023726464:12345-0@lo:101: 00010000:00010000:0.0:1787781833.558571:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781833.558587:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453f82 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781833.558617:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453f82 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781833.558638:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f82 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781833.558648:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030400, rc 0) 00000100:00100000:0.0:1787781833.558693:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023726464:12345-0@lo:101: Request processed in 138us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.558700:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787781833.558754:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023726464:0@lo:101: 00010000:00010000:0.0:1787781833.558771:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781833.558781:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781833.558868:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023726592:0@lo:501: 00000100:00100000:0.0:1787781833.558898:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.558945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023726592 00000100:00100000:0.0:1787781833.558949:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023726592 00000100:00100000:0.0:1787781833.558976:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787781833.558984:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023726592:12345-0@lo:501: 00000100:00100000:0.0:1787781833.559223:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023726592:12345-0@lo:501: Request processed in 239us (324us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787781833.559230:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787781833.559259:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787781833.559273:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023726592:0@lo:501: 10000000:01000000:0.0:1787781833.559308:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787781833.559321:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781833.559329:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787781833.568478:0:7884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787781833.582390:0:7884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 201360598579ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787781833.649453:0:7885:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787781833.649498:0:7885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a715680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7885:1874625023726848:0@lo:7: 00000100:00100000:2.0:1787781833.649499:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023726720:0@lo:13: 00000100:00100000:2.0:1787781833.650924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781833.651852:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023726720 00000100:00100000:3.0:1787781833.651866:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023726720 00000100:00100000:3.0:1787781833.651955:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787781833.651967:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462058780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625023726720:12345-0@lo:13: 00000100:00080000:2.0:1787781833.652000:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787781833.652020:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787781833.652510:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462058780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625023726720:12345-0@lo:13: Request processed in 541us (1590us total) trans 0 rc 0/0 00010000:00080000:2.0:1787781833.652511:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44a716580 x1874625023726720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781833.652527:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787781833.652558:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023726720:0@lo:13: 00000100:00100000:0.0:1787781833.653589:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781833.653647:0:7885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451484600 going to sleep for 11 seconds 00000100:00100000:3.0:1787781833.657070:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023726848 00000100:00100000:3.0:1787781833.657088:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023726848 00000100:00100000:3.0:1787781833.657166:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787781833.657179:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7885:x1874625023726848:12345-0@lo:7: 00002000:00080000:3.0:1787781833.673739:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787781833.673751:0:6694:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787781833.673900:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7885:x1874625023726848:12345-0@lo:7: Request processed in 16717us (20310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781833.673921:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787781833.674747:0:7885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44a715680 x1874625023726848/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787781849 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781833.674766:0:7885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a715680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7885:1874625023726848:0@lo:7: 00000004:00080000:2.0:1787781833.674782:0:7885:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787781833.674854:0:7885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7885:1874625023726976:0@lo:5: 00000100:00100000:2.0:1787781833.674915:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.674967:0:7885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef34316f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781833.675215:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023726976 00000100:00100000:3.0:1787781833.675223:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023726976 00000100:00100000:3.0:1787781833.675287:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787781833.675298:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef46205b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7885:x1874625023726976:12345-0@lo:5: 00002000:00080000:3.0:1787781833.675330:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787781833.675334:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787781833.675712:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef46205b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7885:x1874625023726976:12345-0@lo:5: Request processed in 414us (796us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787781833.675720:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787781833.675767:0:7885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef462058f00 x1874625023726976/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781849 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781833.675784:0:7885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7885:1874625023726976:0@lo:5: 00000004:00080000:3.0:1787781833.678188:0:7885:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787781833.678259:0:7885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a54000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7885:1874625023727104:0@lo:700: 00000100:00100000:3.0:1787781833.681470:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.681636:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023727104 00000100:00100000:2.0:1787781833.681653:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023727104 00000100:00100000:3.0:1787781833.681895:0:7885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787781833.683625:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787781833.683647:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7885:x1874625023727104:12345-0@lo:700: 00000100:00100000:2.0:1787781833.683730:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1874625023727232:0@lo:700: 00000100:00100000:2.0:1787781833.683844:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781833.683942:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef34316f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781833.685223:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023727232 00000100:00100000:0.0:1787781833.685237:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023727232 00000100:00100000:0.0:1787781833.685300:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787781833.685311:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1874625023727232:12345-0@lo:700: 00000004:00080000:0.0:1787781833.744781:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787781833.814899:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787781833.825257:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1874625023727232:12345-0@lo:700: Request processed in 139934us (141402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.825277:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787781833.825631:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef462059e00 x1874625023727232/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787781849 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781833.825652:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1874625023727232:0@lo:700: 40000000:02000000:3.0:1787781833.825671:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:3.0:1787781833.924772:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787781833.956458:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787781833.956486:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1787781833.957143:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7885:x1874625023727104:12345-0@lo:700: Request processed in 273499us (275676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781833.957159:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787781833.957269:0:7885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478a54000 x1874625023727104/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787781849 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781833.957283:0:7885:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787781833.957304:0:7885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a54000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7885:1874625023727104:0@lo:700: 00000004:02000040:1.0:1787781834.053752:0:7885:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787781834.068101:0:7885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7885:1874625023727360:0@lo:5: 00000100:00100000:1.0:1787781834.068391:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781834.068451:0:7885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44328e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781834.069501:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023727360 00000100:00100000:3.0:1787781834.069517:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023727360 00000100:00100000:3.0:1787781834.069690:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787781834.069708:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7885:x1874625023727360:12345-0@lo:5: 00002000:00080000:3.0:1787781834.080209:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787781834.080241:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787781834.088534:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7885:x1874625023727360:12345-0@lo:5: Request processed in 18809us (20124us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787781834.088552:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787781834.088688:0:7885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a05e00 x1874625023727360/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787781850 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781834.088710:0:7885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7885:1874625023727360:0@lo:5: 00000004:00080000:2.0:1787781834.088729:0:7885:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1787781834.430228:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023727488:0@lo:13: 00000100:00100000:2.0:1787781834.430345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781834.430617:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023727488 00000100:00100000:3.0:1787781834.430628:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023727488 00000100:00100000:3.0:1787781834.430681:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787781834.430692:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462058f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023727488:12345-0@lo:13: 00002000:00000024:3.0:1787781834.430744:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781834.430830:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462058f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023727488:12345-0@lo:13: Request processed in 139us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781834.430838:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787781834.430892:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef462058b40 x1874625023727488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781834.430916:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462058b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023727488:0@lo:13: 00010000:00010000:0.0:1787781834.943515:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787781835.492218:0:7999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787781835.966339:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781836.990992:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781838.014271:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781839.043059:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023727872:0@lo:400: 00000100:00100000:1.0:1787781839.043132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781839.043211:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781839.043221:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023728000:0@lo:400: 00000100:00100000:1.0:1787781839.043268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781839.043340:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023727872 00000100:00100000:1.0:1787781839.043347:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023727872 00000100:00100000:1.0:1787781839.043417:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787781839.043431:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023727872:12345-0@lo:400: 00000100:00100000:1.0:1787781839.043507:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023727872:12345-0@lo:400: Request processed in 79us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781839.043529:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787781839.043560:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787781839.043614:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a06580 x1874625023727872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781839.043630:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023727872:0@lo:400: 00000100:00100000:0.0:1787781839.045608:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023728000 00000100:00100000:0.0:1787781839.045618:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023728000 00000100:00080000:1.0:1787781839.045668:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781839.045678:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787781839.045685:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023728000:12345-0@lo:400: 00000100:00100000:0.0:1787781839.045781:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023728000:12345-0@lo:400: Request processed in 96us (2527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781839.045805:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787781839.045882:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a05a40 x1874625023728000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781839.045895:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023728000:0@lo:400: 00000100:00100000:0.0:1787781839.048087:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023727744:0@lo:400: 00000100:00100000:0.0:1787781839.048161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781839.048210:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023728256:0@lo:400: 00000100:00100000:0.0:1787781839.048238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781839.048284:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787781839.048291:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023727616:0@lo:400: 00000100:00100000:0.0:1787781839.048321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781839.048344:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023728128:0@lo:400: 00000100:00100000:0.0:1787781839.048388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781839.048441:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023727616 00000100:00100000:0.0:1787781839.048448:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023727616 00000100:00100000:0.0:1787781839.048505:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787781839.048514:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023727616:12345-0@lo:400: 00000100:00100000:0.0:1787781839.048563:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023727616:12345-0@lo:400: Request processed in 50us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781839.048570:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787781839.048623:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023727616:0@lo:400: 00000100:00100000:1.0:1787781839.050332:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023727744 00000100:00100000:1.0:1787781839.050343:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023727744 00000100:00100000:1.0:1787781839.050397:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023728128 00000100:00100000:1.0:1787781839.050401:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023728128 00000100:00100000:1.0:1787781839.050433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781839.050442:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a715680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023727744:12345-0@lo:400: 00000100:00100000:1.0:1787781839.050531:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a715680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023727744:12345-0@lo:400: Request processed in 90us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781839.050539:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781839.050556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787781839.050562:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023728128:12345-0@lo:400: 00000100:00100000:1.0:1787781839.050591:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023728128:12345-0@lo:400: Request processed in 30us (2203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781839.050597:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787781839.051121:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a04b40 x1874625023728128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781839.051135:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023728128:0@lo:400: 00010000:00080000:1.0:1787781839.051149:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a04f00 x1874625023727744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787781855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781839.051171:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023727744:0@lo:400: 00000100:00100000:0.0:1787781839.051863:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781839.051882:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023728384:0@lo:13: 00000100:00100000:0.0:1787781839.051958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781839.053847:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023728256 00000100:00100000:3.0:1787781839.053860:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023728256 00000100:00100000:3.0:1787781839.054049:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787781839.054062:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef460d60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625023728256:12345-0@lo:400: 00000100:00100000:3.0:1787781839.054152:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef460d60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625023728256:12345-0@lo:400: Request processed in 92us (5912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781839.054159:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787781839.054221:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1787781839.054254:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a07c00 x1874625023728256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781839.054270:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023728256:0@lo:400: 00000100:00080000:1.0:1787781839.055174:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781839.055179:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781839.060696:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023728384 00000100:00100000:0.0:1787781839.060720:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023728384 00000100:00100000:0.0:1787781839.060784:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787781839.060812:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023728384:12345-0@lo:13: 00002000:00000024:0.0:1787781839.060848:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781839.060934:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023728384:12345-0@lo:13: Request processed in 125us (8975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781839.060941:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787781839.061270:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef46205bc00 x1874625023728384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781839.061292:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023728384:0@lo:13: 00000001:00080000:1.0:1787781839.133919:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1787781839.551044:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787781839.551077:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023728512:0@lo:13: 00000100:00100000:3.0:1787781839.551155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781839.551334:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023728512 00000100:00100000:2.0:1787781839.551342:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023728512 00000100:00100000:2.0:1787781839.551396:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787781839.551407:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023728512:12345-0@lo:13: 00002000:00000024:2.0:1787781839.551455:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781839.551526:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023728512:12345-0@lo:13: Request processed in 121us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781839.551533:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787781839.551711:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef46205bc00 x1874625023728512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781839.551730:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023728512:0@lo:13: 00010000:00010000:3.0:1787781840.065804:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781841.086199:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781841.604072:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781841.604254:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005879680 00000100:00100000:0.0:1787781841.604264:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005879680 00000100:00100000:0.0:1787781841.604316:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 111 00000100:00100000:0.0:1787781841.604325:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1874625005879680:12345-192.168.202.56@tcp:250: 00010000:00080000:0.0:1787781841.604369:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c4c21e94-7afd-4aa8-8d79-a4e293aaca46@192.168.202.56@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1787781841.604400:0:5826:0:(genops.c:1385:class_connect()) connect: client c4c21e94-7afd-4aa8-8d79-a4e293aaca46, cookie 0x3ad9816c90453f90 00000100:00080000:0.0:1787781841.606112:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9ef4809af800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781841.606278:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+5:2348:x1874625005879680:12345-192.168.202.56@tcp:250: Request processed in 1951us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.606289:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 111 00000100:00100000:3.0:1787781841.612890:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781841.613098:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005879552 00000100:00100000:0.0:1787781841.613108:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005879552 00000100:00100000:0.0:1787781841.613171:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:0.0:1787781841.613182:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+5:5575:x1874625005879552:12345-192.168.202.56@tcp:101: 00010000:00010000:0.0:1787781841.613198:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781841.613214:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d7c4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781841.613243:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7c4 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781841.613255:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7c4 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781841.613264:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031e00, rc 0) 00000100:00100000:0.0:1787781841.613327:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+6:5575:x1874625005879552:12345-192.168.202.56@tcp:101: Request processed in 147us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.613333:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:1.0:1787781841.618991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781841.619114:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005879808 00000100:00100000:0.0:1787781841.619124:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005879808 00000100:00100000:0.0:1787781841.619245:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00100000:0.0:1787781841.619257:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+6:5575:x1874625005879808:12345-192.168.202.56@tcp:501: 00000100:00100000:0.0:1787781841.619657:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+6:5575:x1874625005879808:12345-192.168.202.56@tcp:501: Request processed in 402us (676us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787781841.619665:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00100000:1.0:1787781841.622993:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781841.623069:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005879936 00000100:00100000:2.0:1787781841.623080:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005879936 00000100:00100000:2.0:1787781841.623174:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 114 00000100:00100000:2.0:1787781841.623184:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+6:5575:x1874625005879936:12345-192.168.202.56@tcp:101: 00010000:00010000:2.0:1787781841.623202:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781841.623221:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d7cb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781841.623250:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7cb expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781841.623263:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7cb expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781841.623272:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8200, rc 0) 00000100:00100000:2.0:1787781841.623334:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+7:5575:x1874625005879936:12345-192.168.202.56@tcp:101: Request processed in 151us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781841.623341:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 114 00000100:00100000:3.0:1787781841.634628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781841.634736:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005880064 00000100:00100000:0.0:1787781841.634746:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005880064 00000100:00100000:0.0:1787781841.634831:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:0.0:1787781841.634850:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+7:5575:x1874625005880064:12345-192.168.202.56@tcp:501: 00000100:00100000:0.0:1787781841.635160:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:5575:x1874625005880064:12345-192.168.202.56@tcp:501: Request processed in 311us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.635168:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:1.0:1787781841.639082:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781841.639178:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005880192 00000100:00100000:2.0:1787781841.639189:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005880192 00000100:00100000:2.0:1787781841.639248:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:2.0:1787781841.639258:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:5575:x1874625005880192:12345-192.168.202.56@tcp:503: 00000100:00100000:2.0:1787781841.640277:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:5575:x1874625005880192:12345-192.168.202.56@tcp:503: Request processed in 1016us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781841.640287:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:1.0:1787781841.644483:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781841.644578:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005880320 00000100:00100000:2.0:1787781841.644588:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005880320 00000100:00100000:2.0:1787781841.644643:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:2.0:1787781841.644653:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:5594:x1874625005880320:12345-192.168.202.56@tcp:502: 00000100:00100000:2.0:1787781841.645023:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:5594:x1874625005880320:12345-192.168.202.56@tcp:502: Request processed in 370us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781841.645031:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:3.0:1787781841.684962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781841.685066:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005880448 00000100:00100000:2.0:1787781841.685077:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005880448 00000100:00100000:2.0:1787781841.685136:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:2.0:1787781841.685147:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:5594:x1874625005880448:12345-192.168.202.56@tcp:502: 00000100:00100000:2.0:1787781841.685845:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:5594:x1874625005880448:12345-192.168.202.56@tcp:502: Request processed in 697us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781841.685854:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:1.0:1787781841.698159:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781841.698419:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005880576 00000100:00100000:0.0:1787781841.698428:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005880576 00000100:00100000:0.0:1787781841.698609:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:0.0:1787781841.698620:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:5575:x1874625005880576:12345-192.168.202.56@tcp:101: 00010000:00010000:0.0:1787781841.698637:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781841.698654:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440031c00/0x3ad9816c90453fa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d7f5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781841.698682:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440031c00/0x3ad9816c90453fa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7f5 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781841.698694:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440031c00/0x3ad9816c90453fa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7f5 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781841.698704:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031c00, rc 0) 00000100:00100000:0.0:1787781841.698767:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5575:x1874625005880576:12345-192.168.202.56@tcp:101: Request processed in 148us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.698774:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:1.0:1787781841.704088:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781841.704283:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005880704 00000100:00100000:0.0:1787781841.704292:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005880704 00000100:00100000:0.0:1787781841.704943:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:0.0:1787781841.704956:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5575:x1874625005880704:12345-192.168.202.56@tcp:256: 20000000:01000000:0.0:1787781841.704995:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787781841.705026:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787781841.705030:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787781841.705034:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787781841.705037:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787781841.707902:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5575:x1874625005880704:12345-192.168.202.56@tcp:256: Request processed in 2937us (3814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.707917:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:1.0:1787781841.711265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781841.711708:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005880832 00000100:00100000:2.0:1787781841.711719:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005880832 00000100:00100000:2.0:1787781841.711780:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:2.0:1787781841.711813:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5575:x1874625005880832:12345-192.168.202.56@tcp:101: 00010000:00010000:2.0:1787781841.711829:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781841.711860:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d7fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781841.711890:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7fc expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781841.711902:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7fc expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781841.711912:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9e00, rc 0) 00000100:00100000:2.0:1787781841.711982:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5575:x1874625005880832:12345-192.168.202.56@tcp:101: Request processed in 193us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781841.711989:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:1.0:1787781841.717884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781841.717971:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005880960 00000100:00100000:0.0:1787781841.717981:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005880960 00000100:00100000:0.0:1787781841.718037:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:0.0:1787781841.718047:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5575:x1874625005880960:12345-192.168.202.56@tcp:501: 00000100:00100000:0.0:1787781841.718334:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5575:x1874625005880960:12345-192.168.202.56@tcp:501: Request processed in 287us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.718341:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:3.0:1787781841.721928:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781841.722098:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005881088 00000100:00100000:0.0:1787781841.722108:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005881088 00000100:00100000:0.0:1787781841.722215:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:0.0:1787781841.722226:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5575:x1874625005881088:12345-192.168.202.56@tcp:503: 00000100:00100000:0.0:1787781841.722628:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5575:x1874625005881088:12345-192.168.202.56@tcp:503: Request processed in 402us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.722636:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:1.0:1787781841.729430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781841.729678:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005881216 00000100:00100000:2.0:1787781841.729688:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005881216 00000100:00100000:2.0:1787781841.729752:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:2.0:1787781841.729763:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5599:x1874625005881216:12345-192.168.202.56@tcp:502: 00000100:00100000:2.0:1787781841.730083:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5599:x1874625005881216:12345-192.168.202.56@tcp:502: Request processed in 321us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781841.730092:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:1.0:1787781841.734268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781841.734503:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005881344 00000100:00100000:0.0:1787781841.734513:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005881344 00000100:00100000:0.0:1787781841.734561:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:0.0:1787781841.734570:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5599:x1874625005881344:12345-192.168.202.56@tcp:502: 00000100:00100000:0.0:1787781841.734829:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5599:x1874625005881344:12345-192.168.202.56@tcp:502: Request processed in 259us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.734847:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:3.0:1787781841.739347:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781841.739750:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005881472 00000100:00100000:1.0:1787781841.739760:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005881472 00000100:00100000:1.0:1787781841.739828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:1.0:1787781841.739837:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1874625005881472:12345-192.168.202.56@tcp:38: 00010000:00080000:1.0:1787781841.739868:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1787781841.739924:0:5835:0:(genops.c:1385:class_connect()) connect: client 3fd2e199-5730-414f-9ae9-e4e10b451cbf, cookie 0x3ad9816c90453fb3 00000004:00100000:1.0:1787781841.739956:0:5835:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787781841.739963:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787781841.788314:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9ef4809aa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781841.788419:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2348:x1874625005881472:12345-192.168.202.56@tcp:38: Request processed in 48580us (49081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781841.788431:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00010000:00010000:3.0:1787781842.110104:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781842.800886:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781842.800968:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005881728 00000100:00100000:1.0:1787781842.800978:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005881728 00000100:00100000:1.0:1787781842.801058:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:1.0:1787781842.801084:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462059e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:5575:x1874625005881728:12345-192.168.202.56@tcp:41: 00000004:00000024:1.0:1787781842.801130:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787781842.801196:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462059e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:5575:x1874625005881728:12345-192.168.202.56@tcp:41: Request processed in 115us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781842.801205:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00080000:2.0:1787781842.801270:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781842.801839:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781842.802019:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005881600 00000100:00100000:0.0:1787781842.802025:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005881600 00000100:00100000:0.0:1787781842.802066:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:0.0:1787781842.802075:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:0:x1874625005881600:12345-192.168.202.56@tcp:41: 00000004:00000024:0.0:1787781842.802093:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787781842.802144:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:0:x1874625005881600:12345-192.168.202.56@tcp:41: Request processed in 70us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781842.802151:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:3.0:1787781842.808102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781842.808505:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005881856 00000100:00100000:0.0:1787781842.808524:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005881856 00000100:00100000:0.0:1787781842.808648:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1787781842.808660:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:5575:x1874625005881856:12345-192.168.202.56@tcp:40: 00000100:00100000:0.0:1787781842.808885:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:5575:x1874625005881856:12345-192.168.202.56@tcp:40: Request processed in 226us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781842.808894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1787781842.821226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781842.824740:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005881984 00000100:00100000:0.0:1787781842.824755:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005881984 00000100:00100000:0.0:1787781842.824843:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:0.0:1787781842.824852:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462058b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874625005881984:12345-192.168.202.56@tcp:8: 00010000:00080000:0.0:1787781842.824886:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1787781842.824935:0:6697:0:(genops.c:1385:class_connect()) connect: client 3fd2e199-5730-414f-9ae9-e4e10b451cbf, cookie 0x3ad9816c90453fba 00002000:00100000:0.0:1787781842.824946:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3fd2e199-5730-414f-9ae9-e4e10b451cbf/ffff9ef4809a8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787781842.824971:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787781842.825588:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787781842.825623:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9ef4809ae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781842.826316:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462058b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2348:x1874625005881984:12345-192.168.202.56@tcp:8: Request processed in 1459us (5093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781842.826329:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1787781842.832618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781842.832664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781842.832741:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781842.835346:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005882112 00000100:00100000:0.0:1787781842.835370:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005882112 00000100:00100000:0.0:1787781842.835447:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:0.0:1787781842.835465:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef46205bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1874625005882112:12345-192.168.202.56@tcp:8: 00010000:00080000:0.0:1787781842.835498:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1787781842.835534:0:6695:0:(genops.c:1385:class_connect()) connect: client 3fd2e199-5730-414f-9ae9-e4e10b451cbf, cookie 0x3ad9816c90453fc1 00002000:00100000:0.0:1787781842.835545:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3fd2e199-5730-414f-9ae9-e4e10b451cbf/ffff9ef4809ab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787781842.835571:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787781842.835966:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787781842.836006:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ef4809ad000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781842.836072:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef46205bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2348:x1874625005882112:12345-192.168.202.56@tcp:8: Request processed in 607us (3464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781842.836080:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:0.0:1787781842.836116:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005882368 00000100:00100000:0.0:1787781842.836121:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005882368 00000100:00100000:0.0:1787781842.836153:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:0.0:1787781842.836161:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:5575:x1874625005882368:12345-192.168.202.56@tcp:33: 00000100:00100000:3.0:1787781842.844953:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005882240 00000100:00100000:3.0:1787781842.844968:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005882240 00000100:00100000:3.0:1787781842.845096:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:3.0:1787781842.845108:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005882240:12345-192.168.202.56@tcp:400: 00000100:00100000:3.0:1787781842.845196:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005882240:12345-192.168.202.56@tcp:400: Request processed in 91us (12531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781842.845204:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 126 00000004:00080000:2.0:1787781842.863171:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26944us 00000004:00200000:0.0:1787781842.892459:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787781842.892639:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:5575:x1874625005882368:12345-192.168.202.56@tcp:33: Request processed in 56473us (59891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781842.892651:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:1.0:1787781843.055037:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781843.055167:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005882496 00000100:00100000:2.0:1787781843.055192:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005882496 00000100:00100000:2.0:1787781843.055256:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1787781843.055268:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:5617:x1874625005882496:12345-192.168.202.56@tcp:101: 00010000:00010000:2.0:1787781843.055296:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781843.055527:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90453fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d826 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781843.057561:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90453fcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781843.057587:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90453fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781843.057607:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90453fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781843.057952:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787781843.057958:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781843.058046:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90453fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781843.058095:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90453fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d826 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781843.058118:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90453fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d826 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781843.058129:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787781843.058133:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781843.058136:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:2.0:1787781843.058242:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:5617:x1874625005882496:12345-192.168.202.56@tcp:101: Request processed in 2975us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781843.058254:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00010000:00010000:3.0:1787781843.135147:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787781843.214903:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00010000:00010000:3.0:1787781844.157889:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781844.158038:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023728896:0@lo:400: 00000100:00100000:0.0:1787781844.158111:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781844.158173:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781844.158181:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023729024:0@lo:400: 00000100:00100000:0.0:1787781844.158208:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781844.158246:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023728896 00000100:00100000:0.0:1787781844.158253:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023728896 00000100:00100000:0.0:1787781844.158305:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787781844.158313:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023728896:12345-0@lo:400: 00000100:00100000:0.0:1787781844.158365:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023728896:12345-0@lo:400: Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781844.158382:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787781844.158494:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023728640:0@lo:400: 00000100:00100000:3.0:1787781844.158546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781844.158568:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023729152:0@lo:400: 00000100:00100000:3.0:1787781844.158587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781844.158604:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787781844.158609:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023728768:0@lo:400: 00000100:00100000:3.0:1787781844.158628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781844.158639:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023729280:0@lo:400: 00000100:00100000:3.0:1787781844.158659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781844.158696:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023728640 00000100:00100000:3.0:1787781844.158701:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023728640 00000100:00100000:3.0:1787781844.158744:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787781844.158751:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023728640:12345-0@lo:400: 00000100:00100000:3.0:1787781844.158805:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023728640:12345-0@lo:400: Request processed in 37us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781844.158811:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1787781844.158839:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781844.158864:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023728640:0@lo:400: 00000100:00100000:3.0:1787781844.158891:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023729152 00000100:00100000:3.0:1787781844.158894:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023729152 00000100:00100000:3.0:1787781844.158917:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023728768 00000100:00100000:3.0:1787781844.158920:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023728768 00000100:00100000:3.0:1787781844.158930:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787781844.158936:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023729152:12345-0@lo:400: 00000100:00100000:3.0:1787781844.158971:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023729152:12345-0@lo:400: Request processed in 35us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781844.158977:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787781844.158989:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787781844.159003:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023728768:12345-0@lo:400: 00000100:00100000:3.0:1787781844.159032:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023728768:12345-0@lo:400: Request processed in 31us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781844.159038:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787781844.159052:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781844.159070:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023728768:0@lo:400: 00000100:00100000:3.0:1787781844.159079:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023729152:0@lo:400: 00000100:00100000:3.0:1787781844.159116:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023729024 00000100:00100000:3.0:1787781844.159119:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023729024 00000100:00100000:3.0:1787781844.159147:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023729280 00000100:00100000:3.0:1787781844.159149:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023729280 00000100:00100000:3.0:1787781844.159164:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787781844.159170:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023729024:12345-0@lo:400: 00000100:00100000:3.0:1787781844.159203:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023729024:12345-0@lo:400: Request processed in 33us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781844.159209:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787781844.159221:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787781844.159227:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023729280:12345-0@lo:400: 00000100:00100000:3.0:1787781844.159257:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023729280:12345-0@lo:400: Request processed in 31us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781844.159263:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787781844.159276:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781844.159279:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787781844.159299:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef4791c1e00 x1874625023729024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781844.159311:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023729024:0@lo:400: 00000100:00100000:3.0:1787781844.159335:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023728896:0@lo:400: 00010000:00080000:3.0:1787781844.159362:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef4791c2940 x1874625023729280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781844.159371:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787781844.159381:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023729280:0@lo:400: 00000100:00100000:3.0:1787781844.163664:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023729408:0@lo:13: 00000100:00100000:3.0:1787781844.163747:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781844.163920:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023729408 00000100:00100000:2.0:1787781844.163928:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023729408 00000100:00100000:2.0:1787781844.163980:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787781844.163991:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023729408:12345-0@lo:13: 00002000:00000024:2.0:1787781844.164016:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781844.164082:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023729408:12345-0@lo:13: Request processed in 94us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781844.164090:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787781844.164771:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44aa3cf00 x1874625023729408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781844.164817:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023729408:0@lo:13: 00000100:00100000:1.0:1787781844.670155:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787781844.672419:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023729536:0@lo:13: 00000100:00100000:1.0:1787781844.672511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781844.677476:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023729536 00000100:00100000:2.0:1787781844.677490:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023729536 00000100:00100000:2.0:1787781844.679426:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787781844.679457:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023729536:12345-0@lo:13: 00002000:00000024:2.0:1787781844.679508:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781844.679607:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023729536:12345-0@lo:13: Request processed in 160us (7095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781844.679614:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787781844.679919:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44aa3d680 x1874625023729536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781844.679942:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023729536:0@lo:13: 00010000:00010000:3.0:1787781845.182074:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781845.320664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781845.320816:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005882624 00000100:00100000:3.0:1787781845.320826:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005882624 00000100:00100000:3.0:1787781845.320917:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1787781845.320928:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:5669:x1874625005882624:12345-192.168.202.56@tcp:41: 00000004:00000024:3.0:1787781845.320972:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787781845.321052:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:5669:x1874625005882624:12345-192.168.202.56@tcp:41: Request processed in 126us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781845.321060:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00080000:0.0:1787781845.323526:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781845.330755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781845.330983:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005882752 00000100:00100000:3.0:1787781845.330992:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005882752 00000100:00100000:3.0:1787781845.331127:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1787781845.331139:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:5669:x1874625005882752:12345-192.168.202.56@tcp:13: 00002000:00000024:3.0:1787781845.331177:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781845.331255:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:5669:x1874625005882752:12345-192.168.202.56@tcp:13: Request processed in 119us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781845.331262:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00080000:0.0:1787781845.332893:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781845.334781:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781845.335039:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005882880 00000100:00100000:0.0:1787781845.335047:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005882880 00000100:00100000:0.0:1787781845.335174:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:0.0:1787781845.335186:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:5669:x1874625005882880:12345-192.168.202.56@tcp:13: 00002000:00000024:0.0:1787781845.335233:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781845.335310:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:5669:x1874625005882880:12345-192.168.202.56@tcp:13: Request processed in 127us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781845.335318:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00080000:3.0:1787781845.335996:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787781846.205988:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787781846.284230:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00010000:00010000:1.0:1787781847.272591:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787781847.358110:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000001:02000400:0.0:1787781847.981574:0:8307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787781848.010984:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781848.011032:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781848.011064:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781848.011087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781848.011115:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005883264 00000100:00100000:1.0:1787781848.011153:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005883264 00000100:00100000:1.0:1787781848.011219:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005883392 00000100:00100000:1.0:1787781848.011222:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005883392 00000100:00100000:1.0:1787781848.011240:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:1.0:1787781848.011261:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005883264:12345-192.168.202.56@tcp:400: 00000100:00100000:1.0:1787781848.011346:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005883264:12345-192.168.202.56@tcp:400: Request processed in 88us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781848.011495:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005883008 00000100:00100000:3.0:1787781848.011501:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005883008 00000100:00100000:3.0:1787781848.011537:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:3.0:1787781848.011545:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2350:x1874625005883008:12345-192.168.202.56@tcp:400: 00000100:00100000:3.0:1787781848.011578:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2350:x1874625005883008:12345-192.168.202.56@tcp:400: Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781848.011586:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:1.0:1787781848.011631:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1787781848.011645:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:1.0:1787781848.011650:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787781848.011656:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005883392:12345-192.168.202.56@tcp:400: 00000100:00100000:1.0:1787781848.011662:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787781848.011689:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005883136 00000100:00100000:3.0:1787781848.011690:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005883392:12345-192.168.202.56@tcp:400: Request processed in 36us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781848.011695:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005883136 00000100:00100000:3.0:1787781848.011700:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:1.0:1787781848.011740:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1787781848.011747:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005883136:12345-192.168.202.56@tcp:400: 00000100:00100000:1.0:1787781848.011817:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005883136:12345-192.168.202.56@tcp:400: Request processed in 39us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781848.011826:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00080000:1.0:1787781848.011848:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787781848.011854:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781848.011856:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787781848.318151:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781849.278068:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023729664:0@lo:13: 00000100:00100000:3.0:1787781849.278173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781849.278306:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023729664 00000100:00100000:2.0:1787781849.278316:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023729664 00000100:00100000:2.0:1787781849.278414:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787781849.278426:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023729664:12345-0@lo:13: 00002000:00000024:2.0:1787781849.278471:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781849.278542:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023729664:12345-0@lo:13: Request processed in 118us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781849.278560:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787781849.278735:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787781849.278772:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44aa3cf00 x1874625023729664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781849.278823:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023729664:0@lo:13: 00000100:00100000:3.0:1787781849.286263:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023729792:0@lo:400: 00000100:00100000:3.0:1787781849.286374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781849.288939:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023729792 00000100:00100000:2.0:1787781849.288961:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023729792 00000100:00100000:3.0:1787781849.288983:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781849.289035:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787781849.289048:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023729792:12345-0@lo:400: 00000100:00100000:3.0:1787781849.289054:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023730304:0@lo:400: 00000100:00100000:1.0:1787781849.289076:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023729920:0@lo:400: 00000100:00100000:0.0:1787781849.289485:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023730048:0@lo:400: 00000100:00100000:2.0:1787781849.291060:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023729792:12345-0@lo:400: Request processed in 2005us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781849.291075:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787781849.291631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781849.291725:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023730176:0@lo:400: 00000100:00100000:3.0:1787781849.291776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781849.291846:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023729792:0@lo:400: 00000100:00100000:3.0:1787781849.291976:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023730176 00000100:00100000:3.0:1787781849.291983:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023730176 00000100:00100000:3.0:1787781849.292121:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787781849.292133:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023730176:12345-0@lo:400: 00000100:00100000:3.0:1787781849.292409:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023730176:12345-0@lo:400: Request processed in 279us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781849.292416:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787781849.292512:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781849.292556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781849.292600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023730304 00000100:00100000:3.0:1787781849.292605:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023730304 00000100:00100000:3.0:1787781849.292643:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023729920 00000100:00100000:3.0:1787781849.292646:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023729920 00000100:00100000:3.0:1787781849.292666:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787781849.292674:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023730304:12345-0@lo:400: 00000100:00100000:3.0:1787781849.292723:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023730304:12345-0@lo:400: Request processed in 50us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781849.292730:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787781849.292745:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787781849.292751:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023729920:12345-0@lo:400: 00000100:00100000:3.0:1787781849.292786:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023729920:12345-0@lo:400: Request processed in 34us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781849.292824:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787781849.292846:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781849.292872:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023729920:0@lo:400: 00000100:00100000:3.0:1787781849.292981:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023730304:0@lo:400: 00010000:00080000:3.0:1787781849.293061:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a05680 x1874625023730176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781849.293074:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023730176:0@lo:400: 00000100:00100000:0.0:1787781849.296641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781849.297129:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023730048 00000100:00100000:3.0:1787781849.297141:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023730048 00000100:00100000:3.0:1787781849.297235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787781849.297248:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023730048:12345-0@lo:400: 00000100:00100000:3.0:1787781849.297358:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023730048:12345-0@lo:400: Request processed in 113us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781849.297366:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787781849.297462:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023730048:0@lo:400: 00000100:00080000:0.0:1787781849.298612:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787781849.352200:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781849.791766:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023730432:0@lo:13: 00000100:00100000:3.0:1787781849.791900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781849.792039:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023730432 00000100:00100000:2.0:1787781849.792049:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023730432 00000100:00100000:2.0:1787781849.792113:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787781849.792123:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023730432:12345-0@lo:13: 00002000:00000024:2.0:1787781849.792168:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781849.792327:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023730432:12345-0@lo:13: Request processed in 205us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781849.792336:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787781849.792501:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44aa3cf00 x1874625023730432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781849.792524:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023730432:0@lo:13: 00010000:00010000:3.0:1787781850.377277:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781851.391253:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787781851.840970:0:8456:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde3960260 20000000:00000080:3.0:1787781851.840998:0:8456:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef478af0000 uarg=0000000000000000 20000000:01000000:3.0:1787781851.841047:0:8456:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787781851.841050:0:8456:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787781851.841054:0:8456:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787781851.841059:0:8456:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787781851.841066:0:8456:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787781851.841084:0:8456:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787781851.841087:0:8456:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787781851.841621:0:8456:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787781851.841626:0:8456:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787781851.843136:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787781851.844675:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787781851.844740:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787781851.844777:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787781851.844978:0:8456:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787781851.844982:0:8456:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787781851.846648:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787781851.847659:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787781851.847749:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787781851.847786:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787781851.848012:0:8456:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787781851.848015:0:8456:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787781851.850905:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787781851.852159:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787781851.852282:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787781851.852322:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787781851.852342:0:8456:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787781851.852345:0:8456:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787781851.855712:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787781851.857727:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787781851.857925:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787781851.858009:0:8456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1787781851.858041:0:8456:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787781851.858072:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858095:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453ecc expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858104:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453ef6 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858111:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f20 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858119:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f2e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858127:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f3c expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858136:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f58 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858157:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453f82 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858168:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7c4 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858175:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7cb expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858185:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858239:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7cb expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.858259:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7cb expref: 9 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.858278:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023730560:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787781851.859249:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7c4 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.862063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:1.0:1787781851.862613:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7c4 expref: 9 pid: 5827 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.862638:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023730688:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781851.862743:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005883520 00000100:00100000:3.0:1787781851.862753:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005883520 00010000:00010000:3.0:1787781851.863066:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7cb expref: 10 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781851.863102:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:3.0:1787781851.863113:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2352:x1874625005883520:12345-192.168.202.56@tcp:103: 00010000:00010000:3.0:1787781851.863130:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781851.863136:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7cb expref: 10 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.863150:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7cb expref: 10 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.863176:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781851.863209:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2352:x1874625005883520:12345-192.168.202.56@tcp:103: Request processed in 97us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781851.863217:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00010000:00010000:2.0:1787781851.863440:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453f82 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.863452:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453f82 expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.863462:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023730816:0@lo:104: 00000100:00100000:2.0:1787781851.863501:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781851.863985:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453f58 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.863996:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453f58 expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.864006:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023730944:0@lo:104: 00000100:00100000:2.0:1787781851.864033:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781851.866486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781851.866606:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005883648 00000100:00100000:3.0:1787781851.866618:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005883648 00010000:00010000:3.0:1787781851.866669:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7c4 expref: 10 pid: 5827 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781851.866709:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:3.0:1787781851.866719:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005883648:12345-192.168.202.56@tcp:103: 00010000:00010000:3.0:1787781851.866737:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781851.866744:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7c4 expref: 10 pid: 5827 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.866781:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7c4 expref: 10 pid: 5827 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.866839:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781851.866899:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005883648:12345-192.168.202.56@tcp:103: Request processed in 181us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781851.866907:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00010000:00010000:2.0:1787781851.874638:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453f3c expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.874662:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453f3c expref: 18 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.874681:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731072:0@lo:104: 00010000:00010000:2.0:1787781851.874746:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453f2e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.874752:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453f2e expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.874758:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731200:0@lo:104: 00010000:00010000:2.0:1787781851.874820:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453f20 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.874829:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453f20 expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.874838:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731328:0@lo:104: 00010000:00010000:2.0:1787781851.874867:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453ef6 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.874882:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453ef6 expref: 18 pid: 5827 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.874890:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4469392c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731456:0@lo:104: 00010000:00010000:2.0:1787781851.874923:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453ecc expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.874932:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453ecc expref: 18 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.874937:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731584:0@lo:104: 00000100:00100000:2.0:1787781851.874953:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451517cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787781851.874984:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8200/0x3ad9816c90453f9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7cb expref: 9 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.874993:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023730560:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781851.875003:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440031e00/0x3ad9816c90453f97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7c4 expref: 8 pid: 5827 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.875009:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023730688:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781851.875637:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787781851.875668:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781851.875682:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781851.875688:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781851.875693:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781851.875698:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781851.875706:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023730816 00000100:00100000:0.0:1787781851.875712:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023730816 00000100:00100000:0.0:1787781851.875752:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023730944 00000100:00100000:0.0:1787781851.875754:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023730944 00000100:00100000:0.0:1787781851.875760:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023731072 00000100:00100000:0.0:1787781851.875761:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023731072 00000100:00100000:0.0:1787781851.875767:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023731200 00000100:00100000:0.0:1787781851.875768:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023731200 00000100:00100000:0.0:1787781851.875773:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023731328 00000100:00100000:0.0:1787781851.875775:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023731328 00000100:00100000:0.0:1787781851.875780:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023731456 00000100:00100000:0.0:1787781851.875781:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023731456 00000100:00100000:0.0:1787781851.875786:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023731584 00000100:00100000:0.0:1787781851.875811:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023731584 00000100:00100000:0.0:1787781851.875827:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781851.875836:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a762580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:8456:x1874625023730816:12345-0@lo:104: 00010000:00010000:0.0:1787781851.875853:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.875932:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781851.875938:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a762580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+9:8456:x1874625023730816:12345-0@lo:104: Request processed in 103us (12437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.875946:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787781851.875957:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781851.875965:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.875966:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787781851.875972:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47916c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+8:8456:x1874625023730944:12345-0@lo:104: 00010000:00010000:3.0:1787781851.875975:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:3.0:1787781851.875980:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.875982:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.875990:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781851.875998:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781851.876004:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781851.876017:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781851.876021:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47916c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+8:8456:x1874625023730944:12345-0@lo:104: Request processed in 50us (11988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.876027:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787781851.876042:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876047:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787781851.876066:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787781851.876069:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.876072:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+7:8456:x1874625023731072:12345-0@lo:104: 00010000:00010000:0.0:1787781851.876080:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876089:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef440030a00/0x3ad9816c90453f82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876103:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787781851.876104:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787781851.876106:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.876108:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+7:8456:x1874625023731072:12345-0@lo:104: Request processed in 37us (441us total) trans 0 rc 0/0 00010000:00010000:3.0:1787781851.876113:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8400 already unused, calling callback (ffffffffc1d18c20) 00000100:00100000:0.0:1787781851.876115:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:00010000:3.0:1787781851.876116:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876123:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.876126:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781851.876131:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+6:8456:x1874625023731200:12345-0@lo:104: 10000000:00010000:3.0:1787781851.876132:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781851.876137:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781851.876139:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876151:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876156:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781851.876167:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1787781851.876173:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876181:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c90453f58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876191:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787781851.876200:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876207:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9c00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:3.0:1787781851.876221:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876229:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781851.876236:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781851.876241:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781851.876260:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876274:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781851.876280:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876286:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9c00/0x3ad9816c90453f3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f43 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876296:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781851.876299:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.876311:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441481e00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:3.0:1787781851.876314:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.876755:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a761a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023730816:0@lo:104: 00000100:00100000:2.0:1787781851.876765:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023730944:0@lo:104: 00000100:00100000:2.0:1787781851.876771:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731072:0@lo:104: 00000100:00100000:2.0:1787781851.876777:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731200:0@lo:104: 00000100:00100000:0.0:1787781851.876845:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+6:8456:x1874625023731200:12345-0@lo:104: Request processed in 712us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.876853:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781851.876872:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787781851.876880:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:8456:x1874625023731328:12345-0@lo:104: 00010000:00010000:0.0:1787781851.876889:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.876976:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781851.876982:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:8456:x1874625023731328:12345-0@lo:104: Request processed in 104us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.876988:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1787781851.877010:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877012:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 10000000:00010000:3.0:1787781851.877019:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877019:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:8456:x1874625023731456:12345-0@lo:104: 10000000:01000000:3.0:1787781851.877025:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781851.877026:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877042:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877049:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781851.877051:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781851.877055:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:8456:x1874625023731456:12345-0@lo:104: Request processed in 38us (1361us total) trans 0 rc 0/0 00010000:00010000:3.0:1787781851.877057:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877062:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787781851.877064:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef441481e00/0x3ad9816c90453f2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f35 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877073:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787781851.877074:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787781851.877078:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877078:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:8456:x1874625023731584:12345-0@lo:104: 00010000:00010000:3.0:1787781851.877084:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8c00 already unused, calling callback (ffffffffc1d18c20) 00010000:00010000:0.0:1787781851.877086:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781851.877087:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877093:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781851.877100:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781851.877111:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781851.877116:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781851.877120:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:8456:x1874625023731584:12345-0@lo:104: Request processed in 43us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.877126:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787781851.877140:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877146:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781851.877150:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787781851.877151:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877157:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90453f20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453f27 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877167:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781851.877169:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877175:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044000 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:3.0:1787781851.877178:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877185:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877187:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023731712:0@lo:103: 10000000:00010000:3.0:1787781851.877191:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781851.877196:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787781851.877208:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781851.877226:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781851.877237:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877243:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482044000/0x3ad9816c90453ecc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453ed3 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.877254:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781851.877255:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781851.877256:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023732224:0@lo:103: 00010000:00010000:3.0:1787781851.877257:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781851.877269:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023731840:0@lo:103: 00000100:00100000:0.0:1787781851.877274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781851.877295:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781851.877296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781851.877300:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023732096:0@lo:103: 00000100:00100000:0.0:1787781851.877441:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023731712 00000100:00100000:0.0:1787781851.877448:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023731712 00010000:00010000:0.0:1787781851.877472:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f82 expref: 19 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877491:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023732224 00000100:00100000:0.0:1787781851.877494:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023732224 00000100:00100000:1.0:1787781851.877683:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1787781851.877744:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f20 expref: 20 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877758:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023731840 00000100:00100000:0.0:1787781851.877761:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023731840 00010000:00010000:0.0:1787781851.877772:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f58 expref: 21 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781851.877824:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787781851.877831:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+21:3304:x1874625023731712:12345-0@lo:103: 00010000:00010000:0.0:1787781851.877852:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781851.877858:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f82 expref: 21 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.877869:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453f82 expref: 21 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.877887:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440030400/0x3ad9816c90453f89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453f82 expref: 21 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.877903:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781851.880611:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+20:3304:x1874625023731712:12345-0@lo:103: Request processed in 2761us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.880631:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787781851.880689:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781851.880710:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023732224:12345-0@lo:103: 00010000:00010000:0.0:1787781851.880733:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781851.880745:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f20 expref: 19 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.880761:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453f20 expref: 19 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.880805:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781851.880879:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023732224:12345-0@lo:103: Request processed in 180us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.880886:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781851.880901:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787781851.880909:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:3305:x1874625023731840:12345-0@lo:103: 00010000:00010000:0.0:1787781851.880938:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781851.880943:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f58 expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.880954:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453f58 expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.880964:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8000/0x3ad9816c90453f5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453f58 expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.880980:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781851.881006:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:3305:x1874625023731840:12345-0@lo:103: Request processed in 98us (3709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781851.881012:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787781851.881129:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781851.881138:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.881147:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9a00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787781851.881152:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.881161:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787781851.881168:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.884011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781851.884079:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023731840:0@lo:103: 00000100:00100000:1.0:1787781851.884079:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023731712:0@lo:103: 00000100:00100000:1.0:1787781851.884092:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023732224:0@lo:103: 00000100:00100000:3.0:1787781851.884096:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023732352:0@lo:103: 00000100:00100000:1.0:1787781851.884147:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023732096 00000100:00100000:1.0:1787781851.884154:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023732096 00000100:00100000:3.0:1787781851.884162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781851.884188:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023732352 00000100:00100000:3.0:1787781851.884191:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023732352 00010000:00010000:1.0:1787781851.884196:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f2e expref: 17 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.884208:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453ecc expref: 18 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.884225:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787781851.884234:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:3304:x1874625023732096:12345-0@lo:103: 00000100:00100000:3.0:1787781851.884235:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787781851.884244:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787781851.884250:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781851.884256:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f2e expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.884267:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453f2e expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.884291:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8600/0x3ad9816c90453f35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453f2e expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.884311:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781851.884351:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:3304:x1874625023732096:12345-0@lo:103: Request processed in 117us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781851.884359:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787781851.884414:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787781851.884420:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450cabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3305:x1874625023732352:12345-0@lo:103: 00010000:00010000:1.0:1787781851.884429:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781851.884434:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453ecc expref: 16 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.884452:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453ecc expref: 16 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.884463:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781851.884480:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023731968:0@lo:103: 00000100:00100000:1.0:1787781851.884485:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450cabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3305:x1874625023732352:12345-0@lo:103: Request processed in 66us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781851.884491:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787781851.884521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781851.884937:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8e00/0x3ad9816c90453f27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453f20 expref: 16 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.884966:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731328:0@lo:104: 00000100:00100000:2.0:1787781851.884986:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4469392c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731456:0@lo:104: 00010000:00010000:2.0:1787781851.884994:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef441480c00/0x3ad9816c90453ed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453ecc expref: 15 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781851.885003:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8456:1874625023731584:0@lo:104: 00010000:00010000:2.0:1787781851.885055:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781851.885935:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787781851.886110:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.886127:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787781851.886155:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781851.886163:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9a00/0x3ad9816c90453ef6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453efd expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781851.886167:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023731968 00000100:00100000:3.0:1787781851.886175:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023731968 00010000:00010000:0.0:1787781851.886192:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781851.886195:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781851.886197:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781851.886205:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781851.886208:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781851.886221:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f3c expref: 14 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781851.886247:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787781851.886291:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023732096:0@lo:103: 00000100:00100000:3.0:1787781851.886435:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:3306:x1874625023731968:12345-0@lo:103: 00010000:00010000:3.0:1787781851.886453:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781851.886460:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453f3c expref: 14 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.886592:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453f3c expref: 14 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.886609:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c90453f43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453f3c expref: 14 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781851.886624:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781851.886691:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:3306:x1874625023731968:12345-0@lo:103: Request processed in 431us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781851.886699:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787781851.886722:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023732480:0@lo:103: 00000100:00100000:3.0:1787781851.886741:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023732352:0@lo:103: 00000100:00100000:2.0:1787781851.886761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781851.886850:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023731968:0@lo:103: 00000100:00100000:1.0:1787781851.886921:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023732480 00000100:00100000:1.0:1787781851.886925:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023732480 00010000:00010000:1.0:1787781851.886943:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453ef6 expref: 13 pid: 5827 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.886967:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787781851.886974:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:3306:x1874625023732480:12345-0@lo:103: 00010000:00010000:1.0:1787781851.886982:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781851.886985:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453ef6 expref: 13 pid: 5827 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.886994:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453ef6 expref: 13 pid: 5827 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887006:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482045c00/0x3ad9816c90453efd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453ef6 expref: 13 pid: 5827 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887048:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887058:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887081:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887089:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887096:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887103:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887109:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441481600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787781851.887113:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887121:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887141:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781851.887151:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781851.887255:0:8456:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.887264:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781851.887270:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef441481600/0x3ad9816c90453fd6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781851.888236:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:3306:x1874625023732480:12345-0@lo:103: Request processed in 1260us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781851.888245:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787781851.888409:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023732480:0@lo:103: 00010000:00010000:3.0:1787781852.414095:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787781853.118705:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787781853.118716:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef444b97000 from 39 10000000:01000000:2.0:1787781853.118723:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781853.118879:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.118913:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.118929:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781853.118962:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4469392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023732608:0@lo:101: 00000100:00100000:2.0:1787781853.119065:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.119181:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4465d4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.120779:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023732608 00000100:00100000:3.0:1787781853.120835:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023732608 00000100:00100000:3.0:1787781853.120919:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787781853.120930:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+12:5830:x1874625023732608:12345-0@lo:101: 00010000:00010000:3.0:1787781853.120950:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781853.120973:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482045200/0x3ad9816c90453fe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453fdd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.121006:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482045200/0x3ad9816c90453fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453fdd expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.121019:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482045200/0x3ad9816c90453fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453fdd expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.121047:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482045200, rc 0) 00000100:00100000:3.0:1787781853.121150:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023732608:12345-0@lo:101: Request processed in 222us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.121158:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787781853.121294:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4469392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023732608:0@lo:101: 00010000:00010000:1.0:1787781853.121313:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.121335:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781853.121437:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023732736:0@lo:501: 00000100:00100000:1.0:1787781853.121472:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.121548:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023732736 00000100:00100000:2.0:1787781853.121553:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023732736 00000100:00100000:2.0:1787781853.121579:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787781853.121586:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023732736:12345-0@lo:501: 00000100:00100000:2.0:1787781853.121906:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023732736:12345-0@lo:501: Request processed in 319us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.121913:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787781853.125945:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781853.126010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781853.126057:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781853.126090:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781853.126202:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005883776 00000100:00100000:0.0:1787781853.126227:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005883776 00000100:00100000:0.0:1787781853.126302:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:0.0:1787781853.126314:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:2352:x1874625005883776:12345-192.168.202.56@tcp:400: 00000100:00100000:0.0:1787781853.126431:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:2352:x1874625005883776:12345-192.168.202.56@tcp:400: Request processed in 118us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.126441:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:0.0:1787781853.126510:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005884032 00000100:00100000:0.0:1787781853.126514:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005884032 00000100:00100000:0.0:1787781853.126553:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005884160 00000100:00100000:0.0:1787781853.126557:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005884160 00000100:00100000:0.0:1787781853.126579:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:0.0:1787781853.126587:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446938b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005884032:12345-192.168.202.56@tcp:400: 00000100:00100000:0.0:1787781853.126620:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446938b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005884032:12345-192.168.202.56@tcp:400: Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.126649:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:0.0:1787781853.126662:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:0.0:1787781853.126669:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005884160:12345-192.168.202.56@tcp:400: 00000100:00100000:0.0:1787781853.126696:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005884160:12345-192.168.202.56@tcp:400: Request processed in 28us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.126703:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00080000:0.0:1787781853.126721:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781853.126726:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781853.131156:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4764323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.131232:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023732736:0@lo:501: 00000100:00100000:1.0:1787781853.131328:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023732864:0@lo:503: 00000100:00100000:1.0:1787781853.131845:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.131895:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4764323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.131946:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023732864 00000100:00100000:3.0:1787781853.131961:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023732864 00000100:00100000:3.0:1787781853.132035:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787781853.132047:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023732864:12345-0@lo:503: 00000100:00100000:3.0:1787781853.132325:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023732864:12345-0@lo:503: Request processed in 279us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.132334:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787781853.132350:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023732864:0@lo:503: 00000100:00100000:2.0:1787781853.132532:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005883904 00000100:00100000:2.0:1787781853.132537:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005883904 00000100:00100000:2.0:1787781853.132598:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:2.0:1787781853.132605:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005883904:12345-192.168.202.56@tcp:400: 00000100:00100000:2.0:1787781853.132667:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005883904:12345-192.168.202.56@tcp:400: Request processed in 64us (6610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.132681:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00080000:0.0:1787781853.134405:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781853.134848:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c1e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8474:1874625023732992:0@lo:502: 00000100:00100000:0.0:1787781853.135011:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781853.135055:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450a756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.135188:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023732992 00000100:00100000:3.0:1787781853.135196:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023732992 00000100:00100000:3.0:1787781853.135271:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787781853.135283:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:8474:x1874625023732992:12345-0@lo:502: 00000100:00100000:3.0:1787781853.136624:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:8474:x1874625023732992:12345-0@lo:502: Request processed in 1338us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.136636:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787781853.144559:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c1e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8474:1874625023732992:0@lo:502: 00000100:00100000:1.0:1787781853.144677:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8474:1874625023733120:0@lo:502: 00000100:00100000:1.0:1787781853.144771:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.144848:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef476432600 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.145026:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023733120 00000100:00100000:3.0:1787781853.145034:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023733120 00000100:00100000:3.0:1787781853.145098:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787781853.145108:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:8474:x1874625023733120:12345-0@lo:502: 00000100:00100000:3.0:1787781853.145735:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:8474:x1874625023733120:12345-0@lo:502: Request processed in 626us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.145745:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787781853.146812:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8474:1874625023733120:0@lo:502: 00000040:00080000:1.0:1787781853.146865:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787781853.152025:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787781853.152077:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787781853.152094:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781853.152111:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787781853.152125:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787781853.152129:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787781853.152133:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787781853.152195:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781853.152240:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781853.152347:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781853.152390:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023733248:0@lo:101: 00000100:00100000:0.0:1787781853.152546:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781853.152606:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450a753c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.153006:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023733248 00000100:00100000:3.0:1787781853.153016:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023733248 00000100:00100000:3.0:1787781853.153113:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787781853.153125:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+13:5830:x1874625023733248:12345-0@lo:101: 00010000:00010000:3.0:1787781853.153142:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781853.153160:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482044000/0x3ad9816c90453ff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453feb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.153190:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482044000/0x3ad9816c90453ff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453feb expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.153202:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482044000/0x3ad9816c90453ff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453feb expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.153224:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044000, rc 0) 00000100:00100000:3.0:1787781853.153780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023733248:12345-0@lo:101: Request processed in 654us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.153826:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787781853.153936:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023733248:0@lo:101: 00010000:00010000:0.0:1787781853.153956:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781853.153968:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781853.154050:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023733376:0@lo:501: 00000100:00100000:0.0:1787781853.154085:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781853.156762:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450a753c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.156947:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023733376 00000100:00100000:1.0:1787781853.156959:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023733376 00000100:00100000:0.0:1787781853.157329:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787781853.157340:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023733376:12345-0@lo:501: 00000100:00100000:0.0:1787781853.157811:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023733376:12345-0@lo:501: Request processed in 448us (3701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.157821:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787781853.158124:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023733376:0@lo:501: 00000100:00100000:1.0:1787781853.158191:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023733504:0@lo:503: 00000100:00100000:1.0:1787781853.158272:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.158304:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef476432600 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.160648:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023733504 00000100:00100000:0.0:1787781853.160667:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023733504 00000100:00100000:0.0:1787781853.160756:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787781853.160769:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023733504:12345-0@lo:503: 00000100:00100000:0.0:1787781853.161112:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023733504:12345-0@lo:503: Request processed in 345us (2838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.161122:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787781853.161370:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023733504:0@lo:503: 00000100:00100000:1.0:1787781853.161695:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8475:1874625023733632:0@lo:502: 00000100:00100000:1.0:1787781853.161752:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.161819:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4764323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.161843:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023733632 00000100:00100000:1.0:1787781853.161848:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023733632 00000100:00100000:1.0:1787781853.161871:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787781853.161878:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:8475:x1874625023733632:12345-0@lo:502: 00000100:00100000:1.0:1787781853.162058:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:8475:x1874625023733632:12345-0@lo:502: Request processed in 179us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.162065:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787781853.162106:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8475:1874625023733632:0@lo:502: 00000020:01000000:1.0:1787781853.162129:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781853.162140:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781853.162143:0:8475:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787781853.162149:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787781853.162172:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8475:1874625023733760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781853.162205:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.162402:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023733760 00000100:00100000:1.0:1787781853.162406:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023733760 00000100:00100000:1.0:1787781853.162435:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787781853.162442:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:8475:x1874625023733760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781853.162556:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:8475:x1874625023733760:12345-0@lo:502:llog_process_th.0 Request processed in 114us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.162563:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787781853.162592:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4764323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.162603:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8475:1874625023733760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781853.162628:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781853.162633:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781853.162635:0:8475:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787781853.162639:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787781853.162696:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787781853.162721:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787781853.162733:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.162745:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781853.162758:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787781853.162761:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef450a67000 from 39 10000000:01000000:1.0:1787781853.162764:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787781853.162829:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.162837:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.162846:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781853.162862:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023733888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787781853.162890:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.162910:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4764323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.162924:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023733888 00000100:00100000:1.0:1787781853.162927:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023733888 00000100:00100000:1.0:1787781853.162945:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787781853.162959:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:5830:x1874625023733888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781853.162970:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781853.162984:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef441480800/0x3ad9816c90454000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90453ff9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.163009:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef441480800/0x3ad9816c90454000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90453ff9 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.163020:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef441480800/0x3ad9816c90454000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453ff9 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.163030:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef441480800, rc 0) 00000100:00100000:1.0:1787781853.163057:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023733888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.163063:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787781853.163087:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023733888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781853.163100:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.163109:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781853.163151:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781853.163174:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.163186:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4764323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.163196:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023734016 00000100:00100000:1.0:1787781853.163199:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023734016 00000100:00100000:3.0:1787781853.164006:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787781853.164022:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023734016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.164594:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023734016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 578us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.164603:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787781853.164962:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781853.165031:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781853.165082:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.165125:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4764323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.165166:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023734144 00000100:00100000:0.0:1787781853.165173:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023734144 00000100:00100000:0.0:1787781853.165226:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787781853.165234:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023734144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781853.165457:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023734144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.165464:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787781853.165745:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.166735:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8476:1874625023734272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.167032:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.167072:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446461480 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.167122:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023734272 00000100:00100000:0.0:1787781853.167130:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023734272 00000100:00100000:0.0:1787781853.167222:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787781853.167232:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:8476:x1874625023734272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781853.167719:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:8476:x1874625023734272:12345-0@lo:502:llog_process_th.0 Request processed in 487us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.167728:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787781853.167836:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8476:1874625023734272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.167906:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8476:1874625023734400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.167943:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.168161:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446461480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781853.170947:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023734400 00000100:00100000:2.0:1787781853.170967:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023734400 00000100:00100000:2.0:1787781853.171048:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787781853.171059:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:8476:x1874625023734400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.171614:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:8476:x1874625023734400:12345-0@lo:502:llog_process_th.0 Request processed in 556us (3669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.171623:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787781853.171906:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8476:1874625023734400:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787781853.171947:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787781853.172288:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787781853.172310:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787781853.172323:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.172335:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781853.172345:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787781853.172348:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787781853.172351:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787781853.172401:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.172410:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.172611:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781853.172637:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.172703:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.172741:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4465d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787781853.172761:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023734528 00000100:00100000:2.0:1787781853.172766:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023734528 00000100:00100000:2.0:1787781853.172831:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787781853.172839:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:5830:x1874625023734528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781853.172851:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781853.172863:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef451415a00/0x3ad9816c9045400e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90454007 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.172889:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef451415a00/0x3ad9816c9045400e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90454007 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.172899:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef451415a00/0x3ad9816c9045400e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454007 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.172910:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415a00, rc 0) 00000100:00100000:2.0:1787781853.172942:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023734528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.172949:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787781853.172997:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781853.173009:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.173019:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781853.173068:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.173101:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.173114:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4465d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787781853.173125:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023734656 00000100:00100000:2.0:1787781853.173129:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023734656 00000100:00100000:2.0:1787781853.173145:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787781853.173150:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023734656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.173544:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023734656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 392us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.173551:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787781853.173579:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.173611:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.173649:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.173662:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4465d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787781853.173673:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023734784 00000100:00100000:2.0:1787781853.173676:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023734784 00000100:00100000:2.0:1787781853.173692:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787781853.173697:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023734784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.173880:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023734784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.173887:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787781853.173919:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023734784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.174139:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8477:1874625023734912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.174176:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.174196:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023734912 00000100:00100000:2.0:1787781853.174205:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023734912 00000100:00100000:3.0:1787781853.174510:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4465d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781853.174689:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787781853.174696:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:8477:x1874625023734912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.174899:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:8477:x1874625023734912:12345-0@lo:502:llog_process_th.0 Request processed in 202us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.174906:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787781853.175088:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8477:1874625023734912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781853.175117:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787781853.175128:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781853.175131:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787781853.175137:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787781853.175165:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8477:1874625023735040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.175203:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.175251:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446461480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781853.175377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023735040 00000100:00100000:2.0:1787781853.175382:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023735040 00000100:00100000:2.0:1787781853.175402:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787781853.175408:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:8477:x1874625023735040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.175551:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:8477:x1874625023735040:12345-0@lo:502:llog_process_th.0 Request processed in 142us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.175558:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787781853.175684:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8477:1874625023735040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781853.175703:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781853.175708:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781853.175710:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787781853.175714:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787781853.176013:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787781853.176035:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787781853.176046:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.176058:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781853.176070:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787781853.176073:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef4450df800 from 39 10000000:01000000:2.0:1787781853.176076:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787781853.176106:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.176115:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.176135:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781853.176153:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.176187:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.176258:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450ce19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.176647:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023735168 00000100:00100000:1.0:1787781853.176654:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023735168 00000100:00100000:3.0:1787781853.176784:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787781853.176821:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023735168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781853.176836:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781853.176852:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482045400/0x3ad9816c9045401c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90454015 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.176881:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482045400/0x3ad9816c9045401c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90454015 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.176905:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482045400/0x3ad9816c9045401c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454015 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.176916:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482045400, rc 0) 00000100:00100000:3.0:1787781853.176966:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023735168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.176974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787781853.177076:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781853.177090:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781853.177100:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781853.177158:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.177191:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.177605:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450ce19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.177686:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023735296 00000100:00100000:0.0:1787781853.177693:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023735296 00000100:00100000:0.0:1787781853.177723:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787781853.177731:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023735296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781853.178062:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023735296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.178071:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787781853.178170:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.178522:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.178577:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.178614:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450ce19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.178674:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023735424 00000100:00100000:0.0:1787781853.178680:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023735424 00000100:00100000:0.0:1787781853.178704:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787781853.178711:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023735424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781853.178931:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023735424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.178937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787781853.179018:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.188152:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8478:1874625023735552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.188330:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.188390:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450ce1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.188506:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023735552 00000100:00100000:0.0:1787781853.188514:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023735552 00000100:00100000:0.0:1787781853.188572:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787781853.188584:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:8478:x1874625023735552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781853.188949:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:8478:x1874625023735552:12345-0@lo:502:llog_process_th.0 Request processed in 366us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.188958:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787781853.189071:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8478:1874625023735552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781853.189133:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8478:1874625023735680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781853.189173:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.189208:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4764323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.189326:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023735680 00000100:00100000:3.0:1787781853.189332:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023735680 00000100:00100000:3.0:1787781853.189379:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787781853.189387:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:8478:x1874625023735680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781853.189551:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:8478:x1874625023735680:12345-0@lo:502:llog_process_th.0 Request processed in 165us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.189558:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787781853.189677:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8478:1874625023735680:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787781853.189698:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787781853.189919:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787781853.189940:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787781853.189953:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.189968:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781853.189980:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787781853.189983:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787781853.189987:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787781853.190017:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.190038:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.190050:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.190068:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.190104:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.190129:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446461b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.190176:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023735808 00000100:00100000:1.0:1787781853.190181:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023735808 00000100:00100000:1.0:1787781853.190219:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787781853.190226:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023735808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781853.190237:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781853.190253:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef441481000/0x3ad9816c9045402a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90454023 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.190278:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef441481000/0x3ad9816c9045402a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90454023 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.190290:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef441481000/0x3ad9816c9045402a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454023 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.190311:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef441481000, rc 0) 00000100:00100000:1.0:1787781853.190343:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023735808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.190349:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787781853.190506:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781853.190521:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.190531:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.190577:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.190600:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.190620:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446461b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.190633:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023735936 00000100:00100000:3.0:1787781853.190636:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023735936 00000100:00100000:3.0:1787781853.190654:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787781853.190661:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023735936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.190955:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023735936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.190962:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787781853.190992:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023735936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.191017:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023736064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.191054:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.191063:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446461b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781853.191079:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023736064 00000100:00100000:3.0:1787781853.191082:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023736064 00000100:00100000:3.0:1787781853.191098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787781853.191104:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023736064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.191302:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023736064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781853.191308:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787781853.191334:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023736064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781853.192962:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8479:1874625023736192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.193040:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781853.193080:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448ea7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781853.193147:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023736192 00000100:00100000:0.0:1787781853.193154:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023736192 00000100:00100000:0.0:1787781853.193200:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787781853.193217:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:8479:x1874625023736192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781853.193597:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:8479:x1874625023736192:12345-0@lo:502:llog_process_th.0 Request processed in 388us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781853.193604:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787781853.193696:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8479:1874625023736192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781853.193736:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781853.193747:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781853.193749:0:8479:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787781853.193756:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787781853.193781:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8479:1874625023736320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781853.193847:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781853.193862:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef476432f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781853.193956:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023736320 00000100:00100000:2.0:1787781853.193960:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023736320 00000100:00100000:2.0:1787781853.194052:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787781853.194061:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:8479:x1874625023736320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781853.194243:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:8479:x1874625023736320:12345-0@lo:502:llog_process_th.0 Request processed in 182us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781853.194250:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787781853.194314:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8479:1874625023736320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787781853.194335:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787781853.194340:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787781853.194341:0:8479:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787781853.194345:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787781853.194441:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787781853.194461:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787781853.194473:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.194486:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781853.194497:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787781853.194509:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef450c2b370 from 1 10000000:01000000:3.0:1787781853.194512:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787781853.194541:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.194550:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.194558:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.194573:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023736448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.194602:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.200009:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4464619c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.200194:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023736448 00000100:00100000:1.0:1787781853.200207:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023736448 00000100:00100000:1.0:1787781853.200290:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787781853.200302:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023736448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781853.200323:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781853.200350:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef441481600/0x3ad9816c90454038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90454031 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.200399:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef441481600/0x3ad9816c90454038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90454031 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.200413:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef441481600/0x3ad9816c90454038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454031 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781853.200566:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef441481600, rc 0) 00000100:00100000:1.0:1787781853.200693:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023736448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 392us (6089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781853.200702:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787781853.200856:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023736448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781853.200876:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.200887:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781853.200967:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023736576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781853.201003:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781853.201029:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4464619c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781853.201309:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023736576 00000100:00100000:1.0:1787781853.201315:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023736576 00000100:00100000:1.0:1787781853.201338:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787781853.201344:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023736576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781853.201656:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023736576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (651us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787781853.201665:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787781853.201938:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023736576:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787781853.201969:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787781853.201978:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781853.202001:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781853.438143:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781854.398096:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781854.398440:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023736960:0@lo:400:kworker.0 00000100:00100000:0.0:1787781854.398558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781854.398639:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781854.398646:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023737088:0@lo:400:kworker.0 00000100:00100000:0.0:1787781854.398693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781854.398732:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023737216:0@lo:400:kworker.0 00000100:00100000:0.0:1787781854.398762:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781854.398826:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781854.398834:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023736832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781854.398863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781854.398903:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023737216 00000100:00100000:0.0:1787781854.398912:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023737216 00000100:00100000:0.0:1787781854.398986:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787781854.398997:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023737216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781854.399055:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023737216:12345-0@lo:400:kworker.0 Request processed in 60us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781854.399063:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787781854.399094:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787781854.399133:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef4790a5e00 x1874625023737216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781854.399150:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023737216:0@lo:400:kworker.0 00000100:00100000:0.0:1787781854.399192:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023736832 00000100:00100000:0.0:1787781854.399196:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023736832 00000100:00100000:0.0:1787781854.399232:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787781854.399238:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023736832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781854.399275:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781854.399315:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023736832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781854.399322:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787781854.399358:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023736960 00000100:00100000:0.0:1787781854.399372:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023736960 00000100:00100000:0.0:1787781854.399400:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023737088 00000100:00100000:0.0:1787781854.399403:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023737088 00000100:00100000:0.0:1787781854.399419:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787781854.399425:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023736960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781854.399463:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023736960:12345-0@lo:400:kworker.0 Request processed in 38us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781854.399469:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787781854.399481:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787781854.399488:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023737088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781854.399515:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023737088:12345-0@lo:400:kworker.0 Request processed in 29us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781854.399521:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787781854.399535:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781854.399538:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787781854.399556:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478f9f480 x1874625023736832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781854.399573:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023736832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781854.399598:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023737088:0@lo:400:kworker.0 00000100:00100000:0.0:1787781854.399609:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023736960:0@lo:400:kworker.0 00000100:00100000:2.0:1787781854.399816:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023736704:0@lo:400:kworker.0 00000100:00100000:2.0:1787781854.399861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781854.400014:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023736704 00000100:00100000:0.0:1787781854.400019:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023736704 00000100:00100000:0.0:1787781854.400632:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787781854.400642:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023736704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781854.400706:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023736704:12345-0@lo:400:kworker.0 Request processed in 66us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781854.400726:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787781854.401008:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023736704:0@lo:400:kworker.0 00000100:00100000:3.0:1787781854.401191:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787781854.401204:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023737344:0@lo:400:kworker.0 00000100:00100000:3.0:1787781854.401735:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781854.401823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023737344 00000100:00100000:3.0:1787781854.401830:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023737344 00000100:00100000:3.0:1787781854.401879:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787781854.401887:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023737344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781854.401935:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023737344:12345-0@lo:400:kworker.0 Request processed in 48us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781854.401943:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787781854.401976:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023737344:0@lo:400:kworker.0 00000100:00080000:3.0:1787781854.402002:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787781854.467284:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781854.910216:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446939e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023737472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781854.910313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781854.910493:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023737472 00000100:00100000:3.0:1787781854.910505:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023737472 00000100:00100000:3.0:1787781854.910580:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787781854.910590:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023737472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781854.910639:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781854.910695:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023737472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781854.910702:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787781854.911576:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef446939e00 x1874625023737472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781854.911604:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446939e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023737472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781855.234940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781855.235155:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005884288 00000100:00100000:1.0:1787781855.235166:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005884288 00000100:00100000:1.0:1787781855.238063:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:1.0:1787781855.238147:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:5590:x1874625005884288:12345-192.168.202.56@tcp:101: 00010000:00010000:1.0:1787781855.238166:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781855.238196:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef441481400/0x3ad9816c9045403f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d82d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781855.238228:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef441481400/0x3ad9816c9045403f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d82d expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781855.238249:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef441481400/0x3ad9816c9045403f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d82d expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781855.238258:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef441481400, rc 0) 00000100:00100000:1.0:1787781855.238333:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5590:x1874625005884288:12345-192.168.202.56@tcp:101: Request processed in 257us (3404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781855.238350:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:1.0:1787781855.242164:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781855.242521:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005884416 00000100:00100000:0.0:1787781855.242532:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005884416 00000100:00100000:0.0:1787781855.242690:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:0.0:1787781855.242700:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5590:x1874625005884416:12345-192.168.202.56@tcp:501: 00000100:00100000:0.0:1787781855.243118:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5590:x1874625005884416:12345-192.168.202.56@tcp:501: Request processed in 419us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781855.243127:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:3.0:1787781855.256014:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781855.257227:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005884544 00000100:00100000:1.0:1787781855.257237:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005884544 00000100:00100000:1.0:1787781855.257300:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:1.0:1787781855.257311:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5590:x1874625005884544:12345-192.168.202.56@tcp:503: 00000100:00100000:1.0:1787781855.257563:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5590:x1874625005884544:12345-192.168.202.56@tcp:503: Request processed in 245us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781855.257572:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:0.0:1787781855.263032:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781855.263815:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005884672 00000100:00100000:1.0:1787781855.263827:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005884672 00000100:00100000:1.0:1787781855.263884:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:1.0:1787781855.263895:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:6074:x1874625005884672:12345-192.168.202.56@tcp:502: 00000100:00100000:1.0:1787781855.264166:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:6074:x1874625005884672:12345-192.168.202.56@tcp:502: Request processed in 272us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781855.264175:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:3.0:1787781855.267063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781855.267166:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005884800 00000100:00100000:1.0:1787781855.267181:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005884800 00000100:00100000:1.0:1787781855.268677:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:1.0:1787781855.268693:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:6074:x1874625005884800:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787781855.268990:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:6074:x1874625005884800:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 301us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781855.268999:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:3.0:1787781855.274227:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781855.279364:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005884928 00000100:00100000:2.0:1787781855.279385:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005884928 00000100:00100000:2.0:1787781855.279554:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:2.0:1787781855.279577:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5590:x1874625005884928:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781855.279606:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781855.279629:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef451414c00/0x3ad9816c90454046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d834 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781855.279668:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef451414c00/0x3ad9816c90454046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d834 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781855.279681:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef451414c00/0x3ad9816c90454046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d834 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781855.279715:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414c00, rc 0) 00000100:00100000:2.0:1787781855.280302:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5590:x1874625005884928:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 721us (6083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781855.280313:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:2.0:1787781855.290069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781855.290165:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005885056 00000100:00100000:1.0:1787781855.290176:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005885056 00000100:00100000:1.0:1787781855.290311:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:1.0:1787781855.290323:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5590:x1874625005885056:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781855.290630:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5590:x1874625005885056:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 309us (571us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787781855.290639:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 170 00010000:00010000:3.0:1787781855.486055:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781856.509985:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787781857.098977:0:8517:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb026ff30 20000000:00000080:2.0:1787781857.098996:0:8517:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef478fb8400 uarg=0000000000000000 20000000:01000000:2.0:1787781857.099038:0:8517:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787781857.099043:0:8517:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787781857.099048:0:8517:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787781857.100238:0:8518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787781857.100492:0:8517:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787781857.108148:0:8517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787781857.108267:0:8517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787781857.108402:0:8517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787781857.108434:0:8517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787781857.108454:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.108472:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b9000/0x3ad9816c90453e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e0f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.108480:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453e86 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.108487:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90453ee8 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.108497:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7fc expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.108505:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.108542:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7fc expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.108558:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7fc expref: 9 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781857.108572:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8517:1874625023737600:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781857.108683:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453ee8 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.108692:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453ee8 expref: 18 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781857.108701:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8517:1874625023737728:0@lo:104: 00000100:00100000:3.0:1787781857.108742:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781857.109456:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453e86 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.109467:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453e86 expref: 18 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781857.109476:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8517:1874625023737856:0@lo:104: 00000100:00100000:3.0:1787781857.109505:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787781857.110773:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b9000/0x3ad9816c90453e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90453e0f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.110811:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef4432b9000/0x3ad9816c90453e16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90453e0f expref: 18 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781857.110825:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8517:1874625023737984:0@lo:104: 00000100:00100000:3.0:1787781857.110857:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4464610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781857.113217:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787781857.113265:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781857.113352:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023737728 00000100:00100000:0.0:1787781857.113361:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023737728 00000100:00100000:0.0:1787781857.113545:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023737856 00000100:00100000:0.0:1787781857.113549:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023737856 00000100:00100000:0.0:1787781857.113564:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023737984 00000100:00100000:0.0:1787781857.113566:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023737984 00000100:00100000:0.0:1787781857.113579:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787781857.113586:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:8517:x1874625023737728:12345-0@lo:104: 00010000:00010000:0.0:1787781857.113619:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781857.113770:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787781857.113777:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:8517:x1874625023737728:12345-0@lo:104: Request processed in 191us (5035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781857.113785:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787781857.113826:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781857.113833:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:8517:x1874625023737856:12345-0@lo:104: 00010000:00010000:0.0:1787781857.113841:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781857.113889:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787781857.113895:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:8517:x1874625023737856:12345-0@lo:104: Request processed in 63us (4390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781857.113901:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787781857.113933:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781857.113939:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:8517:x1874625023737984:12345-0@lo:104: 00010000:00010000:0.0:1787781857.113946:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781857.113985:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787781857.113990:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:8517:x1874625023737984:12345-0@lo:104: Request processed in 52us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781857.113995:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787781857.114091:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787781857.114098:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114105:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031600 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:2.0:1787781857.114109:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114117:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787781857.114124:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781857.114130:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787781857.114173:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114192:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787781857.114215:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114224:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90453ee8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453eef expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114238:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787781857.114242:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114247:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044c00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:2.0:1787781857.114250:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114257:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787781857.114264:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781857.114269:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787781857.114290:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114297:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787781857.114312:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114319:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90453e86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e8d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114346:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787781857.114349:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114355:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031800 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:2.0:1787781857.114358:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114365:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787781857.114371:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781857.114376:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787781857.114390:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114396:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787781857.114644:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114654:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90453e0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90453e16 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.114669:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781857.114671:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781857.114673:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781857.114689:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4469383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023738112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781857.114736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781857.114809:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023738240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781857.114832:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781857.114854:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781857.114860:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023738368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781857.114880:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781857.114908:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023738112 00000100:00100000:2.0:1787781857.114912:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023738112 00010000:00010000:2.0:1787781857.114934:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453ee8 expref: 19 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781857.114954:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023738240 00000100:00100000:2.0:1787781857.114959:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023738240 00010000:00010000:2.0:1787781857.114969:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e86 expref: 20 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781857.114980:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023738368 00000100:00100000:2.0:1787781857.114982:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023738368 00010000:00010000:2.0:1787781857.114992:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b9000/0x3ad9816c90453e16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e0f expref: 21 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781857.115005:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787781857.115011:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446939680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+21:3306:x1874625023738112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787781857.115021:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781857.115026:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453ee8 expref: 21 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.115036:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453ee8 expref: 21 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.115078:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781857.115108:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446939680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+21:3306:x1874625023738112:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781857.115114:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787781857.115129:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787781857.115134:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+20:3303:x1874625023738240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787781857.115142:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781857.115146:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e86 expref: 20 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.115155:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453e86 expref: 20 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.115164:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781857.115189:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+20:3303:x1874625023738240:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781857.115195:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787781857.115206:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787781857.115211:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023738368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787781857.115218:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781857.115222:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b9000/0x3ad9816c90453e16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90453e0f expref: 19 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.115229:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b9000/0x3ad9816c90453e16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90453e0f expref: 19 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.115238:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781857.115263:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023738368:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781857.115270:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787781857.115562:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4469383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023738112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781857.115584:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023738368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787781857.115592:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023738240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781857.115777:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:1.0:1787781857.115806:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781857.115833:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781857.116089:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440031000/0x3ad9816c90453eef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453ee8 expref: 18 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781857.116101:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8517:1874625023737728:0@lo:104: 00010000:00010000:3.0:1787781857.116185:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482044a00/0x3ad9816c90453e8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453e86 expref: 17 pid: 5827 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781857.116203:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8517:1874625023737856:0@lo:104: 00010000:00010000:3.0:1787781857.116215:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b9000/0x3ad9816c90453e16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90453e0f expref: 16 pid: 5826 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781857.116223:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8517:1874625023737984:0@lo:104: 00000100:00100000:0.0:1787781857.116363:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781857.116435:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005885184 00000100:00100000:1.0:1787781857.116441:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005885184 00010000:00010000:1.0:1787781857.116463:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7fc expref: 10 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781857.116492:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:1.0:1787781857.116500:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2352:x1874625005885184:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781857.116510:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781857.116515:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7fc expref: 10 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116525:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7fc expref: 10 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116541:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116549:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116564:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116581:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116589:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116595:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116600:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787781857.116605:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116613:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116622:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781857.116631:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781857.116676:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2352:x1874625005885184:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 176us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781857.116683:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00010000:00010000:3.0:1787781857.117250:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b9e00/0x3ad9816c90453fac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7fc expref: 9 pid: 5825 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781857.117262:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8517:1874625023737600:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781857.117295:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.117304:0:8517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.117311:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781857.117318:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482045600/0x3ad9816c9045404d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781857.534044:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787781858.173925:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787781858.173939:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef444b97000 from 4 10000000:01000000:0.0:1787781858.173945:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787781858.173991:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781858.174004:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781858.174015:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781858.174041:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023738496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787781858.174108:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781858.174158:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4789176c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781858.174515:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023738496 00000100:00100000:3.0:1787781858.174522:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023738496 00000100:00100000:3.0:1787781858.174575:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787781858.174584:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023738496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781858.174597:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781858.174611:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90454054 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.174644:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90454054 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.174656:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454054 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.174667:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482045600, rc 0) 00000100:00100000:3.0:1787781858.174727:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023738496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.174734:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787781858.174838:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023738496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781858.174854:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781858.174864:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781858.174932:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023738624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781858.174960:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.174987:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787781858.175319:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023738624 00000100:00100000:0.0:1787781858.175324:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023738624 00000100:00100000:0.0:1787781858.175362:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787781858.175370:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023738624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781858.175624:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023738624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781858.175633:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787781858.175833:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023738624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781858.175866:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023738752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781858.175904:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.175934:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781858.176056:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023738752 00000100:00100000:3.0:1787781858.176061:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023738752 00000100:00100000:3.0:1787781858.176092:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787781858.176099:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023738752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781858.176262:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023738752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.176269:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787781858.176389:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023738752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781858.178136:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8567:1874625023738880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781858.178191:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.178224:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781858.178277:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023738880 00000100:00100000:3.0:1787781858.178284:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023738880 00000100:00100000:3.0:1787781858.178376:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787781858.178386:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:8567:x1874625023738880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781858.178594:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:8567:x1874625023738880:12345-0@lo:502:llog_process_th.0 Request processed in 210us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.178601:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787781858.178674:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8567:1874625023738880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787781858.178703:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787781858.178713:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787781858.178716:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787781858.178726:0:8567:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef444b97000 00000020:00000080:0.0:1787781858.178728:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787781858.180994:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8567:1874625023739008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787781858.181069:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.183928:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023739008 00000100:00100000:1.0:1787781858.183943:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023739008 00000100:00100000:1.0:1787781858.184042:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787781858.184051:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:8567:x1874625023739008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781858.184920:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:8567:x1874625023739008:12345-0@lo:502:llog_process_th.0 Request processed in 868us (3849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.184930:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787781858.185516:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478917c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781858.185543:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8567:1874625023739008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781858.185579:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781858.185588:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781858.185590:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787781858.185601:0:8567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787781858.185729:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787781858.185747:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787781858.185757:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781858.185768:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781858.185779:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787781858.185781:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef450a67000 from 4 10000000:01000000:2.0:1787781858.185784:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787781858.185947:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781858.185957:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781858.185967:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781858.185986:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787781858.186038:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781858.186077:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023739136 00000100:00100000:2.0:1787781858.186081:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451484d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781858.186083:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023739136 00000100:00100000:3.0:1787781858.186126:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787781858.186134:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023739136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781858.186145:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781858.186157:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90454062 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.186192:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90454062 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.186203:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454062 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.186212:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044a00, rc 0) 00000100:00100000:3.0:1787781858.186249:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023739136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.186257:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787781858.189970:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781858.189995:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781858.190006:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781858.190067:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781858.190117:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.190144:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451484d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781858.192168:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023739264 00000100:00100000:0.0:1787781858.192181:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023739264 00000100:00100000:0.0:1787781858.192588:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787781858.192599:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023739264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781858.192903:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023739264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (2783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781858.192911:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787781858.193165:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781858.193220:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781858.193267:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.193296:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451484d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781858.193307:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023739392 00000100:00100000:2.0:1787781858.193320:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023739392 00000100:00100000:2.0:1787781858.193352:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787781858.193359:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023739392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781858.193507:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023739392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.193513:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787781858.193559:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781858.195741:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8570:1874625023739520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781858.195833:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.195872:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451484480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781858.195894:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023739520 00000100:00100000:3.0:1787781858.195901:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023739520 00000100:00100000:3.0:1787781858.195949:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787781858.195958:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:8570:x1874625023739520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781858.196152:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:8570:x1874625023739520:12345-0@lo:502:llog_process_th.0 Request processed in 195us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.196172:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787781858.196879:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8570:1874625023739520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781858.196910:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781858.196919:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781858.196922:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787781858.196927:0:8570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef450a67000 00000020:00000080:2.0:1787781858.196930:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787781858.197016:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8570:1874625023739648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781858.197066:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781858.197088:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451484480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781858.197672:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023739648 00000100:00100000:3.0:1787781858.197678:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023739648 00000100:00100000:3.0:1787781858.197716:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787781858.197723:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:8570:x1874625023739648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781858.198624:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:8570:x1874625023739648:12345-0@lo:502:llog_process_th.0 Request processed in 898us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.198639:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787781858.198641:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8570:1874625023739648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781858.198667:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781858.198673:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781858.198675:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787781858.198678:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787781858.198894:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787781858.198916:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781858.198925:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.198935:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781858.198944:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781858.198947:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef4450df800 from 4 10000000:01000000:3.0:1787781858.198949:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781858.198975:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.198982:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.198990:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781858.199005:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781858.199036:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781858.199067:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44506f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787781858.200005:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023739776 00000100:00100000:2.0:1787781858.200013:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023739776 00000100:00100000:2.0:1787781858.200050:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787781858.201091:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023739776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781858.201110:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781858.201127:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90454070 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781858.201156:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90454070 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781858.201166:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454070 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781858.201182:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414600, rc 0) 00000100:00100000:2.0:1787781858.201260:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023739776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (2223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.201268:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787781858.202984:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781858.203008:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781858.203020:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781858.203093:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781858.203145:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.203492:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787781858.205128:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023739904 00000100:00100000:3.0:1787781858.205139:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023739904 00000100:00100000:3.0:1787781858.205206:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787781858.205216:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023739904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781858.205521:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023739904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.205534:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787781858.205847:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023739904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781858.205894:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023740032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781858.205936:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.205968:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787781858.206668:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023740032 00000100:00100000:3.0:1787781858.206675:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023740032 00000100:00100000:3.0:1787781858.206718:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787781858.206727:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023740032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781858.206928:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023740032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.206935:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787781858.207140:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023740032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781858.207698:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8571:1874625023740160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781858.207741:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.207773:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781858.208070:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023740160 00000100:00100000:3.0:1787781858.208076:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023740160 00000100:00100000:3.0:1787781858.208114:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787781858.208122:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:8571:x1874625023740160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781858.208535:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:8571:x1874625023740160:12345-0@lo:502:llog_process_th.0 Request processed in 413us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.208543:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787781858.208634:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8571:1874625023740160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781858.208661:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781858.208671:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781858.208673:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787781858.208680:0:8571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef4450df800 00000020:00000080:1.0:1787781858.208682:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787781858.208769:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8571:1874625023740288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781858.208901:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781858.208925:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023740288 00000100:00100000:1.0:1787781858.208929:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023740288 00000100:00100000:1.0:1787781858.208951:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787781858.208958:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:8571:x1874625023740288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781858.209077:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:8571:x1874625023740288:12345-0@lo:502:llog_process_th.0 Request processed in 119us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.209084:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787781858.209119:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781858.209131:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:8571:1874625023740288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781858.209148:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787781858.209152:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781858.209745:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787781858.209751:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787781858.210095:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787781858.210118:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781858.210128:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.210140:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781858.263583:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781858.263620:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781858.263654:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781858.263681:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781858.263703:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005885312 00000100:00100000:0.0:1787781858.263703:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005885568 00000100:00100000:1.0:1787781858.263711:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005885312 00000100:00100000:0.0:1787781858.263711:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005885568 00000100:00100000:0.0:1787781858.263748:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005885696 00000100:00100000:0.0:1787781858.263751:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005885696 00000100:00100000:1.0:1787781858.263753:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:1.0:1787781858.263761:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:2351:x1874625005885312:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781858.263769:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1787781858.263775:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005885568:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781858.263844:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:2351:x1874625005885312:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.263852:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:1.0:1787781858.263885:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005885440 00000100:00100000:1.0:1787781858.263896:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005885440 00000100:00100000:0.0:1787781858.263913:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005885568:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 137us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781858.263921:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:1.0:1787781858.263927:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:1.0:1787781858.263933:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005885440:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781858.263933:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:0.0:1787781858.263939:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005885696:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781858.263964:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005885696:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781858.263971:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00080000:0.0:1787781858.263987:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781858.263991:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781858.263993:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781858.269858:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005885440:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 5913us (6191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.269872:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00010000:00010000:2.0:1787781858.561187:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781858.954269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781858.954394:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005885824 00000100:00100000:3.0:1787781858.954404:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005885824 00000100:00100000:3.0:1787781858.954463:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:3.0:1787781858.954472:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:5590:x1874625005885824:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781858.954502:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781858.954521:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d83b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.954550:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d83b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.954562:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d83b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781858.954570:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044200, rc 0) 00000100:00100000:3.0:1787781858.954629:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5590:x1874625005885824:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 158us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.954637:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:1.0:1787781858.958562:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781858.958651:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005885952 00000100:00100000:2.0:1787781858.958660:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005885952 00000100:00100000:2.0:1787781858.958711:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:2.0:1787781858.958720:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5590:x1874625005885952:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781858.959026:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5590:x1874625005885952:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 305us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.959033:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:3.0:1787781858.965479:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781858.965555:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005886080 00000100:00100000:2.0:1787781858.965566:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005886080 00000100:00100000:2.0:1787781858.965624:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:2.0:1787781858.965635:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5590:x1874625005886080:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781858.965899:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:5590:x1874625005886080:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 265us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781858.965906:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:1.0:1787781858.972763:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781858.972820:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005886208 00000100:00100000:1.0:1787781858.972830:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005886208 00000100:00100000:1.0:1787781858.972877:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:1.0:1787781858.972886:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:6139:x1874625005886208:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787781858.973125:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:6139:x1874625005886208:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 239us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781858.973132:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:0.0:1787781858.977437:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781858.980014:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005886336 00000100:00100000:3.0:1787781858.980028:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005886336 00000100:00100000:3.0:1787781858.980121:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:3.0:1787781858.980132:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:6139:x1874625005886336:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787781858.980565:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:6139:x1874625005886336:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 433us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781858.980574:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:2.0:1787781859.518291:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023740416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781859.518406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781859.518588:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023740416 00000100:00100000:0.0:1787781859.518598:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023740416 00000100:00100000:0.0:1787781859.518708:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787781859.518718:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023740416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781859.518762:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787781859.518976:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781859.519748:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023740416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1026us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781859.519759:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787781859.519948:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023740544:0@lo:400:kworker.0 00000100:00100000:3.0:1787781859.520009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781859.520039:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023741056:0@lo:400:kworker.0 00000100:00100000:3.0:1787781859.520062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781859.520092:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781859.520098:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023740928:0@lo:400:kworker.0 00000100:00100000:3.0:1787781859.520119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781859.520419:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023740672:0@lo:400:kworker.0 00000100:00100000:0.0:1787781859.520450:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781859.520582:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781859.520588:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023740800:0@lo:400:kworker.0 00000100:00100000:0.0:1787781859.520610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781859.520645:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023740928 00000100:00100000:0.0:1787781859.520652:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023740928 00000100:00100000:0.0:1787781859.520708:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781859.520716:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023740928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781859.520761:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023740928:12345-0@lo:400:kworker.0 Request processed in 46us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781859.520767:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787781859.520826:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478f9f0c0 x1874625023740928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781859.520842:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023740928:0@lo:400:kworker.0 00000100:00100000:0.0:1787781859.520913:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023741056 00000100:00100000:0.0:1787781859.520917:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023741056 00000100:00100000:0.0:1787781859.520938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023740672 00000100:00100000:0.0:1787781859.520941:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023740672 00000100:00100000:0.0:1787781859.520950:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023740800 00000100:00100000:0.0:1787781859.520952:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023740800 00000100:00100000:0.0:1787781859.520974:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787781859.520980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023741056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781859.521023:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023741056:12345-0@lo:400:kworker.0 Request processed in 43us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781859.521029:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787781859.521039:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787781859.521045:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023740672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781859.521072:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023740672:12345-0@lo:400:kworker.0 Request processed in 27us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781859.521077:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787781859.521087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787781859.521092:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023740800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781859.521117:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023740800:12345-0@lo:400:kworker.0 Request processed in 25us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781859.521123:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787781859.521156:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023740800:0@lo:400:kworker.0 00000100:00100000:0.0:1787781859.521165:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023740672:0@lo:400:kworker.0 00000100:00100000:0.0:1787781859.521186:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023741056:0@lo:400:kworker.0 00000100:00080000:0.0:1787781859.522095:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781859.522105:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787781859.522365:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478f9f840 x1874625023740416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781859.529461:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023740544 00000100:00100000:1.0:1787781859.529477:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023740544 00000100:00100000:1.0:1787781859.529553:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787781859.529564:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023740544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781859.529659:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023740544:12345-0@lo:400:kworker.0 Request processed in 98us (9650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781859.529667:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787781859.529738:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023740544:0@lo:400:kworker.0 00000100:00100000:2.0:1787781859.530158:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023740416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787781859.582405:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781860.030202:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023741184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781860.030321:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781860.030438:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023741184 00000100:00100000:3.0:1787781860.030449:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023741184 00000100:00100000:3.0:1787781860.030526:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787781860.030545:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023741184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781860.030598:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781860.030671:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023741184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781860.030679:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787781860.030972:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44693a580 x1874625023741184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781860.031072:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023741184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787781860.606315:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781861.631372:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781862.660877:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781863.361901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781863.362033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781863.362068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781863.362095:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781863.362143:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005886720 00000100:00100000:3.0:1787781863.362156:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005886720 00000100:00100000:3.0:1787781863.362252:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005886848 00000100:00100000:3.0:1787781863.362255:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005886848 00000100:00100000:3.0:1787781863.362301:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1787781863.362313:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005886720:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781863.362408:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005886720:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 98us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781863.362416:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1787781863.362436:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1787781863.362442:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005886848:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781863.362469:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005886848:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781863.362489:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1787781863.362514:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005886592 00000100:00100000:3.0:1787781863.362519:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005886592 00000100:00100000:3.0:1787781863.362556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:3.0:1787781863.362564:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005886592:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781863.362979:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005886592:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 414us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781863.362987:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00080000:3.0:1787781863.363026:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787781863.363032:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781863.363034:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781863.363864:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005886464 00000100:00100000:1.0:1787781863.363946:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005886464 00000100:00100000:1.0:1787781863.363999:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:1.0:1787781863.364008:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005886464:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781863.364064:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005886464:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 57us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781863.364071:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 193 00000001:02000400:0.0:1787781863.648436:0:8816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787781863.678917:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781864.640017:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023741312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781864.640084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781864.640664:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023741440:0@lo:400:kworker.0 00000100:00100000:2.0:1787781864.640699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781864.640728:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781864.640733:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023741568:0@lo:400:kworker.0 00000100:00100000:2.0:1787781864.640755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781864.640783:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023741568 00000100:00100000:2.0:1787781864.640805:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023741568 00000100:00100000:2.0:1787781864.640844:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787781864.640852:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023741568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781864.640896:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023741568:12345-0@lo:400:kworker.0 Request processed in 45us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781864.640903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787781864.640947:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023741568:0@lo:400:kworker.0 00000100:00100000:1.0:1787781864.641058:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781864.641064:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023741696:0@lo:400:kworker.0 00000100:00100000:1.0:1787781864.641088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781864.641146:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023741312 00000100:00100000:1.0:1787781864.641150:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023741312 00000100:00100000:1.0:1787781864.641193:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787781864.641200:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023741312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781864.641301:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781864.641340:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023741312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781864.641347:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787781864.641368:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023741440 00000100:00100000:1.0:1787781864.641371:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023741440 00000100:00100000:1.0:1787781864.641400:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787781864.641404:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023741440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781864.641436:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023741440:12345-0@lo:400:kworker.0 Request processed in 31us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781864.641442:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787781864.641475:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023741440:0@lo:400:kworker.0 00010000:00080000:1.0:1787781864.641497:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478f9de00 x1874625023741312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781864.641511:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023741312:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787781864.642314:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781864.642419:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781864.642430:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023741952:0@lo:400:kworker.0 00000100:00100000:0.0:1787781864.642466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781864.642499:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023741824:0@lo:400:kworker.0 00000100:00100000:2.0:1787781864.642525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781864.642562:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023741824 00000100:00100000:2.0:1787781864.642566:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023741824 00000100:00100000:2.0:1787781864.642599:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787781864.642606:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023741824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781864.642641:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023741824:12345-0@lo:400:kworker.0 Request processed in 35us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781864.642647:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787781864.642671:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787781864.642689:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44a7152c0 x1874625023741824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781864.642700:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023741824:0@lo:400:kworker.0 00000100:00100000:3.0:1787781864.654425:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023741696 00000100:00100000:3.0:1787781864.654438:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023741696 00000100:00100000:3.0:1787781864.654497:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023741952 00000100:00100000:3.0:1787781864.654500:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023741952 00000100:00100000:3.0:1787781864.654520:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787781864.654529:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023741696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781864.654615:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023741696:12345-0@lo:400:kworker.0 Request processed in 87us (13526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781864.654623:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787781864.654637:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787781864.654643:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023741952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781864.654674:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023741952:12345-0@lo:400:kworker.0 Request processed in 31us (12207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781864.654680:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787781864.654702:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781864.654737:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023741696:0@lo:400:kworker.0 00000100:00100000:0.0:1787781864.655732:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023741952:0@lo:400:kworker.0 00010000:00010000:1.0:1787781864.710237:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781865.152557:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781865.152580:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023742080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781865.152648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781865.158125:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023742080 00000100:00100000:3.0:1787781865.158140:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023742080 00000100:00100000:3.0:1787781865.158220:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787781865.158232:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023742080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781865.158281:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781865.158388:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023742080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (5739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781865.158395:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787781865.161396:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef446938000 x1874625023742080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781865.161423:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023742080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781865.726044:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781866.749982:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781867.774210:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781868.487616:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781868.487667:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781868.487696:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781868.487723:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781868.487747:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005887104 00000100:00100000:3.0:1787781868.487758:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005887104 00000100:00100000:3.0:1787781868.487858:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:3.0:1787781868.487870:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005887104:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781868.487944:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005887104:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 77us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781868.487953:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:3.0:1787781868.487977:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005887232 00000100:00100000:3.0:1787781868.487980:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005887232 00000100:00100000:3.0:1787781868.488008:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005887360 00000100:00100000:3.0:1787781868.488011:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005887360 00000100:00100000:3.0:1787781868.488031:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1787781868.488037:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2348:x1874625005887232:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:3.0:1787781868.488090:0:8308:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453fba 00000100:00080000:3.0:1787781868.488101:0:8308:0:(import.c:65:import_set_state_nolock()) ffff9ef4809ae000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787781868.488138:0:8308:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787781868.488444:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+2:2348:x1874625005887232:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 405us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781868.488451:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1787781868.488464:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:3.0:1787781868.488470:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2348:x1874625005887360:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:3.0:1787781868.488484:0:8308:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453fc1 00000100:00080000:3.0:1787781868.488490:0:8308:0:(import.c:65:import_set_state_nolock()) ffff9ef4809ad000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787781868.488510:0:8308:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787781868.488688:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+2:2348:x1874625005887360:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 217us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781868.488696:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00080000:3.0:1787781868.488717:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781868.488720:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787781868.488722:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787781868.488911:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781868.489181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005886976 00000100:00100000:1.0:1787781868.489186:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005886976 00000100:00100000:1.0:1787781868.489235:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:1.0:1787781868.489244:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005886976:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781868.489279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005886976:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781868.489285:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 195 00010000:00010000:1.0:1787781868.489310:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781868.799915:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787781868.826004:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:3.0:1787781868.826014:0:6719:0:(genops.c:885:class_export_put()) final put ffff9ef4809a8000/3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:3.0:1787781868.826048:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef4809a8000/3fd2e199-5730-414f-9ae9-e4e10b451cbf for lustre-OST0000 00000020:00000080:3.0:1787781868.826107:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef4809ae000 for lustre-OST0000 00000001:02000400:2.0:1787781869.487192:0:9062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing yml_node 00000100:00100000:0.0:1787781869.759714:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023742208:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.759850:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781869.759914:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023742720:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.759946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781869.759976:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787781869.759982:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023742336:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.760005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781869.760025:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023742848:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.760074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781869.760120:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023742464:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.760148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781869.760167:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781869.760172:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023742592:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.760193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781869.760241:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023742208 00000100:00100000:0.0:1787781869.761833:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023742208 00000100:00100000:0.0:1787781869.761924:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787781869.761945:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023742208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.762043:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023742208:12345-0@lo:400:kworker.0 Request processed in 101us (2195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781869.762051:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787781869.762103:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023742720 00000100:00100000:0.0:1787781869.762109:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023742720 00000100:00100000:0.0:1787781869.762147:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023742336 00000100:00100000:0.0:1787781869.762151:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023742336 00000100:00100000:0.0:1787781869.762165:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023742464 00000100:00100000:0.0:1787781869.762168:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023742464 00000100:00100000:0.0:1787781869.762183:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787781869.762190:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a761a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023742720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.762238:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a761a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023742720:12345-0@lo:400:kworker.0 Request processed in 48us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781869.762437:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787781869.762450:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1787781869.762691:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781869.762712:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023742848 00000100:00100000:2.0:1787781869.762717:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023742848 00000100:00100000:2.0:1787781869.762769:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023742592 00000100:00100000:2.0:1787781869.762773:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023742592 00000100:00100000:2.0:1787781869.762814:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787781869.762821:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476778780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023742848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781869.762867:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476778780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023742848:12345-0@lo:400:kworker.0 Request processed in 48us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781869.762873:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787781869.762886:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787781869.762891:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476779e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023742592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781869.762930:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476779e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023742592:12345-0@lo:400:kworker.0 Request processed in 38us (2736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781869.762936:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787781869.762952:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787781869.762960:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787781869.762966:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a762580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023742336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781869.762997:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a762580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023742336:12345-0@lo:400:kworker.0 Request processed in 32us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781869.763015:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787781869.763027:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787781869.763034:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787781869.763039:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023742464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781869.763069:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023742464:12345-0@lo:400:kworker.0 Request processed in 31us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781869.763076:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787781869.763610:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781869.763615:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787781869.763673:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44a763c00 x1874625023742592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781869.763692:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023742592:0@lo:400:kworker.0 00000100:00100000:2.0:1787781869.763714:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023742464:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.766551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787781869.769079:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023742336:0@lo:400:kworker.0 00010000:00080000:0.0:1787781869.769106:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44a7612c0 x1874625023742848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781869.769120:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023742848:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.769133:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023742208:0@lo:400:kworker.0 00000100:00100000:0.0:1787781869.769146:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023742720:0@lo:400:kworker.0 00000100:00100000:2.0:1787781869.775759:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781869.775819:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023742976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781869.775940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781869.776180:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023742976 00000100:00100000:3.0:1787781869.776189:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023742976 00000100:00100000:3.0:1787781869.782021:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787781869.782045:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023742976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781869.782115:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781869.782268:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023742976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (6328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781869.782278:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787781869.782365:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44693a940 x1874625023742976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781869.782402:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023742976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787781869.836761:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781870.273625:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4767783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023743104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781870.273735:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781870.273983:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023743104 00000100:00100000:0.0:1787781870.273994:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023743104 00000100:00100000:0.0:1787781870.274055:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787781870.274068:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023743104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781870.274133:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781870.274188:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023743104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781870.274196:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787781870.274338:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef4767783c0 x1874625023743104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781870.274364:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4767783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023743104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781870.847294:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781871.889135:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787781871.917462:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:1.0:1787781871.917475:0:7652:0:(genops.c:885:class_export_put()) final put ffff9ef4809ab800/3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:2.0:1787781871.918085:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef4809ab800/3fd2e199-5730-414f-9ae9-e4e10b451cbf for lustre-OST0001 00000020:00000080:2.0:1787781871.918147:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef4809ad000 for lustre-OST0001 00010000:00010000:0.0:1787781872.895554:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781873.603690:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781873.603766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781873.603987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005887616 00000100:00100000:2.0:1787781873.604001:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005887616 00000100:00100000:2.0:1787781873.604119:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:2.0:1787781873.604141:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005887616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781873.604263:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005887616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 133us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781873.604293:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00080000:3.0:1787781873.604902:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781873.605331:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005887488 00000100:00100000:1.0:1787781873.605343:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005887488 00000100:00100000:1.0:1787781873.605398:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 197 00000100:00100000:1.0:1787781873.605406:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2352:x1874625005887488:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781873.605476:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2352:x1874625005887488:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 70us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781873.605601:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 197 00010000:00010000:1.0:1787781873.921780:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781874.878206:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023743488:0@lo:400:kworker.0 00000100:00100000:3.0:1787781874.878314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781874.878411:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781874.878418:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023743616:0@lo:400:kworker.0 00000100:00100000:3.0:1787781874.878448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781874.878507:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023743616 00000100:00100000:3.0:1787781874.878516:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023743616 00000100:00100000:3.0:1787781874.878590:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787781874.878602:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023743616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781874.878663:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023743616:12345-0@lo:400:kworker.0 Request processed in 64us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781874.878678:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787781874.878706:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787781874.878735:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478f9d680 x1874625023743616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781874.878750:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023743616:0@lo:400:kworker.0 00000100:00100000:3.0:1787781874.878821:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023743488 00000100:00100000:3.0:1787781874.878825:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023743488 00000100:00100000:3.0:1787781874.878869:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787781874.878876:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023743488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781874.878911:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023743488:12345-0@lo:400:kworker.0 Request processed in 36us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781874.878917:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787781874.878959:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781874.878966:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023744000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781874.878997:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781874.879032:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023744000 00000100:00100000:3.0:1787781874.879036:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023744000 00000100:00100000:3.0:1787781874.879068:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787781874.879075:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023744000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781874.879112:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781874.879147:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023744000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781874.879154:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787781874.879180:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787781874.879184:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787781874.879198:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb6580 x1874625023744000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781874.879222:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023744000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781874.879244:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023743488:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.879733:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023743232:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.879778:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.879842:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023743744:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.879876:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.879899:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787781874.879905:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023743360:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.879923:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.879937:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023743872:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.879956:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781874.879985:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023743744 00000100:00100000:0.0:1787781874.879991:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023743744 00000100:00100000:0.0:1787781874.880041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023743360 00000100:00100000:0.0:1787781874.880045:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023743360 00000100:00100000:0.0:1787781874.880065:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787781874.880073:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023743744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.880543:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023743744:12345-0@lo:400:kworker.0 Request processed in 469us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781874.880551:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787781874.880570:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787781874.880577:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023743360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.880609:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023743360:12345-0@lo:400:kworker.0 Request processed in 33us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781874.880628:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787781874.880650:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023743872 00000100:00100000:0.0:1787781874.880654:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023743872 00000100:00100000:0.0:1787781874.880680:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787781874.880686:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476779680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023743872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.880715:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476779680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023743872:12345-0@lo:400:kworker.0 Request processed in 30us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781874.880721:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787781874.880764:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023743360:0@lo:400:kworker.0 00010000:00080000:0.0:1787781874.880776:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb5680 x1874625023743872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781874.880809:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023743872:0@lo:400:kworker.0 00000100:00100000:0.0:1787781874.880821:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023743744:0@lo:400:kworker.0 00000100:00100000:3.0:1787781874.881551:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023743232 00000100:00100000:3.0:1787781874.881558:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023743232 00000100:00100000:3.0:1787781874.881637:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787781874.881646:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023743232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781874.881702:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023743232:12345-0@lo:400:kworker.0 Request processed in 57us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781874.881708:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1787781874.881779:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781874.881833:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023743232:0@lo:400:kworker.0 00010000:00010000:2.0:1787781874.946058:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781875.393184:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781875.393217:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023744128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781875.393333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781875.393421:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023744128 00000100:00100000:0.0:1787781875.393430:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023744128 00000100:00100000:0.0:1787781875.393709:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787781875.393721:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023744128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781875.393771:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1787781875.400611:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47677b480 x1874625023744128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781875.400652:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023744128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781875.400747:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023744128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7025us (7411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781875.400761:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787781875.965937:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787781875.971992:0:9258:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.56 00010000:00010000:2.0:1787781876.996594:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781878.014726:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781878.724707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781878.724759:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781878.724821:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005887872 00000100:00100000:2.0:1787781878.724834:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005887872 00000100:00100000:3.0:1787781878.724888:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005887744 00000100:00100000:3.0:1787781878.724893:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005887744 00000100:00100000:2.0:1787781878.724927:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:2.0:1787781878.724940:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446938780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005887872:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781878.725044:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446938780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005887872:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 107us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781878.725054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00080000:2.0:1787781878.725099:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781878.725155:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:3.0:1787781878.725165:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005887744:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781878.725195:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005887744:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781878.725201:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 199 00010000:00010000:3.0:1787781879.039093:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787781879.535730:0:9356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.56 00000100:00100000:3.0:1787781879.997978:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781879.998002:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023744256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781879.998080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781879.998167:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023744256 00000100:00100000:3.0:1787781879.998175:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023744256 00000100:00100000:3.0:1787781879.998236:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787781879.998245:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023744256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781879.998297:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781879.998345:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023744256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781879.998352:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787781879.998374:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787781879.998405:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb6580 x1874625023744256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781879.998423:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023744256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781879.998596:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023744512:0@lo:400:kworker.0 00000100:00100000:0.0:1787781879.998627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781879.998648:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781879.998653:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023744640:0@lo:400:kworker.0 00000100:00100000:0.0:1787781879.998674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781879.998704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023744512 00000100:00100000:0.0:1787781879.998708:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023744512 00000100:00100000:0.0:1787781879.998735:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023744640 00000100:00100000:0.0:1787781879.998738:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023744640 00000100:00100000:0.0:1787781879.998760:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787781879.998767:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476779a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023744512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781879.998829:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476779a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023744512:12345-0@lo:400:kworker.0 Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781879.998836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787781879.998848:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787781879.998854:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476778b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023744640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781879.998879:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476778b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023744640:12345-0@lo:400:kworker.0 Request processed in 26us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781879.998885:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787781879.998921:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023744640:0@lo:400:kworker.0 00000100:00100000:0.0:1787781879.998931:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023744512:0@lo:400:kworker.0 00000100:00100000:2.0:1787781879.999266:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023744768:0@lo:400:kworker.0 00000100:00100000:2.0:1787781879.999300:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781879.999331:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787781879.999337:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4767792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023744384:0@lo:400:kworker.0 00000100:00100000:2.0:1787781879.999363:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781879.999383:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476778f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023744896:0@lo:400:kworker.0 00000100:00100000:2.0:1787781879.999402:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781879.999464:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023744768 00000100:00100000:0.0:1787781879.999469:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023744768 00000100:00100000:0.0:1787781879.999507:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787781879.999514:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023744768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781879.999553:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023744768:12345-0@lo:400:kworker.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781879.999568:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787781879.999598:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47677ad00 x1874625023744768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781879.999608:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023744768:0@lo:400:kworker.0 00000100:00100000:0.0:1787781879.999625:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023744896 00000100:00100000:0.0:1787781879.999628:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023744896 00000100:00100000:0.0:1787781879.999652:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787781879.999657:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023744896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781879.999691:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023744896:12345-0@lo:400:kworker.0 Request processed in 34us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781879.999697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787781879.999723:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476778f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023744896:0@lo:400:kworker.0 00000100:00100000:3.0:1787781880.000691:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023744384 00000100:00100000:3.0:1787781880.000699:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023744384 00000100:00100000:3.0:1787781880.000754:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787781880.000763:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023744384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781880.004016:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023744384:12345-0@lo:400:kworker.0 Request processed in 3244us (4641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781880.004032:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1787781880.004088:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787781880.004094:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781880.004331:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4767792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023744384:0@lo:400:kworker.0 00010000:00010000:1.0:1787781880.062984:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781880.510421:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4767792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023745024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781880.510507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781880.511090:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023745024 00000100:00100000:3.0:1787781880.511099:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023745024 00000100:00100000:3.0:1787781880.511169:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787781880.511178:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023745024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781880.511334:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781880.511680:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023745024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 502us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781880.511687:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787781880.515242:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef4767792c0 x1874625023745024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781880.515270:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4767792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023745024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787781881.086693:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781882.109893:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787781882.137673:0:9453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.56 00010000:00010000:1.0:1787781883.137263:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787781883.617557:0:9502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 18:04:43 EDT 2026 00000100:00100000:0.0:1787781883.853326:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781883.853730:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781883.857420:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005888000 00000100:00100000:1.0:1787781883.857438:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005888000 00000100:00100000:1.0:1787781883.857523:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:1.0:1787781883.857536:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2352:x1874625005888000:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781883.857642:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2352:x1874625005888000:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 108us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781883.857651:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:2.0:1787781883.858694:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005888128 00000100:00100000:2.0:1787781883.858704:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005888128 00000100:00100000:2.0:1787781883.858924:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:2.0:1787781883.858932:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005888128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781883.858999:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005888128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 68us (5685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781883.859006:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00080000:0.0:1787781883.859131:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787781884.158138:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781885.118718:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781885.118750:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023745152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781885.120045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781885.120425:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023745280:0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.120485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781885.120544:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476778f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023745792:0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.120572:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781885.120602:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787781885.120608:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023745408:0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.120629:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781885.120645:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4767792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023745920:0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.120688:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781885.120735:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023745664:0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.120778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781885.120837:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781885.120843:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4767783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625023745536:0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.120866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781885.120898:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023745280 00000100:00100000:0.0:1787781885.120906:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023745280 00000100:00100000:0.0:1787781885.120973:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787781885.120983:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023745280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.121046:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023745280:12345-0@lo:400:kworker.0 Request processed in 64us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781885.121054:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787781885.121104:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023745792 00000100:00100000:0.0:1787781885.121108:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023745792 00000100:00100000:0.0:1787781885.121150:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023745408 00000100:00100000:0.0:1787781885.121153:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023745408 00000100:00100000:0.0:1787781885.121164:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023745536 00000100:00100000:0.0:1787781885.121166:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023745536 00000100:00100000:0.0:1787781885.121180:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787781885.121186:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023745792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.121220:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023745792:12345-0@lo:400:kworker.0 Request processed in 34us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781885.121226:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787781885.121237:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787781885.121242:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023745408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.121266:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023745408:12345-0@lo:400:kworker.0 Request processed in 25us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781885.121279:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787781885.121291:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787781885.121296:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625023745536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.121327:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625023745536:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781885.121333:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787781885.121356:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023745920 00000100:00100000:0.0:1787781885.121359:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023745920 00000100:00100000:0.0:1787781885.121387:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023745664 00000100:00100000:0.0:1787781885.121389:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023745664 00000100:00100000:0.0:1787781885.121408:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787781885.121415:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023745920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.121446:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023745920:12345-0@lo:400:kworker.0 Request processed in 32us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781885.121452:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787781885.121462:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787781885.121467:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023745664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.121492:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023745664:12345-0@lo:400:kworker.0 Request processed in 25us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781885.121498:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787781885.121553:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023745408:0@lo:400:kworker.0 00010000:00080000:0.0:1787781885.121570:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef4767792c0 x1874625023745920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781885.121581:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4767792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023745920:0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.121591:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023745280:0@lo:400:kworker.0 00000100:00100000:0.0:1787781885.121610:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476778f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023745792:0@lo:400:kworker.0 00000100:00080000:0.0:1787781885.121647:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781885.121652:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781885.121655:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781885.121674:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4767783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625023745536:0@lo:400:kworker.0 00010000:00080000:0.0:1787781885.121683:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47677bc00 x1874625023745664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781885.121691:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023745664:0@lo:400:kworker.0 00000100:00100000:1.0:1787781885.132191:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023745152 00000100:00100000:1.0:1787781885.132223:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023745152 00000100:00100000:0.0:1787781885.133286:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787781885.133302:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023745152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781885.133360:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781885.133500:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023745152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (13460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781885.133508:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787781885.143403:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb6580 x1874625023745152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781885.144581:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023745152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787781885.184971:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781885.630236:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781885.632154:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023746048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781885.632266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781885.634238:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023746048 00000100:00100000:2.0:1787781885.634258:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023746048 00000100:00100000:2.0:1787781885.634338:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787781885.634349:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023746048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781885.634400:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781885.634614:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023746048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 266us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781885.634622:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787781885.635237:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478e4c3c0 x1874625023746048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781885.635263:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023746048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781886.206668:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781887.230215:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781888.254056:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781888.963301:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781888.963381:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781888.963463:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005888384 00000100:00100000:1.0:1787781888.963474:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005888384 00000100:00100000:1.0:1787781888.963552:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:1.0:1787781888.963564:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005888384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781888.963653:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005888384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 80us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781888.963662:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00080000:0.0:1787781888.963844:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781888.964270:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005888256 00000100:00100000:3.0:1787781888.964276:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005888256 00000100:00100000:3.0:1787781888.964354:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:3.0:1787781888.964363:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005888256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781888.964409:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005888256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 47us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781888.964415:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 203 00010000:00010000:2.0:1787781889.279273:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781890.238298:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023746176:0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.238392:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781890.238451:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023746688:0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.238491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781890.238526:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781890.238532:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023746560:0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.238556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781890.238585:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023746304:0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.238611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781890.238630:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023746816:0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.238654:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781890.238673:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781890.238678:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023746432:0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.238698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781890.238853:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023746176 00000100:00100000:1.0:1787781890.238861:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023746176 00000100:00100000:3.0:1787781890.238941:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023746688 00000100:00100000:3.0:1787781890.238946:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023746688 00000100:00100000:1.0:1787781890.241675:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787781890.241696:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023746176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781890.241815:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023746176:12345-0@lo:400:kworker.0 Request processed in 127us (3423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781890.241823:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787781890.242410:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023746176:0@lo:400:kworker.0 00000100:00100000:3.0:1787781890.242622:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023746304 00000100:00100000:3.0:1787781890.242630:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023746304 00000100:00100000:3.0:1787781890.242648:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023746432 00000100:00100000:3.0:1787781890.242651:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023746432 00000100:00100000:3.0:1787781890.242671:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787781890.242678:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023746688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781890.242729:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023746688:12345-0@lo:400:kworker.0 Request processed in 52us (4237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781890.242735:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787781890.242748:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787781890.242753:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023746304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781890.242836:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787781890.242846:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023746432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.244229:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023746944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781890.244309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781890.244384:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023746560 00000100:00100000:0.0:1787781890.244391:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023746560 00000100:00100000:0.0:1787781890.244523:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023746816 00000100:00100000:0.0:1787781890.244527:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023746816 00000100:00100000:0.0:1787781890.244557:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787781890.244566:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023746560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.244622:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023746560:12345-0@lo:400:kworker.0 Request processed in 57us (6065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.244629:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787781890.244646:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787781890.244652:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023746816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781890.245334:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023746944 00000100:00100000:2.0:1787781890.245341:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023746944 00000100:00100000:2.0:1787781890.245381:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787781890.245389:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023746944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787781890.245427:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781890.245485:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023746944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781890.245492:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787781890.246073:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023746304:12345-0@lo:400:kworker.0 Request processed in 3315us (7456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781890.246083:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787781890.247999:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023746432:12345-0@lo:400:kworker.0 Request processed in 5145us (9289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781890.248014:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787781890.248377:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb4f00 x1874625023746560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781890.248396:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023746560:0@lo:400:kworker.0 00000100:00100000:1.0:1787781890.248420:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023746688:0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.248780:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023746816:12345-0@lo:400:kworker.0 Request processed in 4125us (10121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.248811:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787781890.248859:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781890.248870:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781890.248874:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781890.248907:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023746432:0@lo:400:kworker.0 00000100:00100000:0.0:1787781890.248919:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023746304:0@lo:400:kworker.0 00010000:00080000:0.0:1787781890.248933:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb70c0 x1874625023746816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781890.248943:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023746816:0@lo:400:kworker.0 00010000:00080000:0.0:1787781890.248973:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef446938000 x1874625023746944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781890.248993:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023746944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787781890.302158:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781890.751007:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023747072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781890.751191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781890.751328:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023747072 00000100:00100000:0.0:1787781890.751351:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023747072 00000100:00100000:0.0:1787781890.751422:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787781890.751435:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023747072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781890.751483:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781890.751552:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023747072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781890.751559:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787781890.751683:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478e4cb40 x1874625023747072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781890.751707:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023747072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781891.327101:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781892.350539:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781893.374176:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781894.085925:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781894.085985:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781894.086536:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005888512 00000100:00100000:3.0:1787781894.086551:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005888512 00000100:00100000:3.0:1787781894.086629:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:3.0:1787781894.086643:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2350:x1874625005888512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781894.086746:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2350:x1874625005888512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 106us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781894.086754:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:3.0:1787781894.086812:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005888640 00000100:00100000:3.0:1787781894.086817:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005888640 00000100:00100000:3.0:1787781894.086868:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:3.0:1787781894.086877:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005888640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781894.087107:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005888640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 231us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781894.087115:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00080000:3.0:1787781894.087135:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787781894.403626:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781895.358350:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023747200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781895.358447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781895.358579:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023747200 00000100:00100000:0.0:1787781895.358588:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023747200 00000100:00100000:0.0:1787781895.358661:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787781895.358670:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023747200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781895.358735:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781895.358825:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023747200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781895.358834:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787781895.358898:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44693a940 x1874625023747200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781895.358919:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023747200:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787781895.359117:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781895.359364:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023747456:0@lo:400:kworker.0 00000100:00100000:1.0:1787781895.359406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781895.359436:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787781895.359441:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023747328:0@lo:400:kworker.0 00000100:00100000:1.0:1787781895.359468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781895.359487:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023747840:0@lo:400:kworker.0 00000100:00100000:1.0:1787781895.359504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781895.359553:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023747456 00000100:00100000:2.0:1787781895.359558:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023747456 00000100:00100000:2.0:1787781895.359597:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023747840 00000100:00100000:2.0:1787781895.359599:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023747840 00000100:00100000:2.0:1787781895.359624:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787781895.359632:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023747456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781895.359676:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023747456:12345-0@lo:400:kworker.0 Request processed in 46us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781895.359683:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787781895.359699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787781895.359704:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023747840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781895.359739:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023747840:12345-0@lo:400:kworker.0 Request processed in 35us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781895.359745:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787781895.359763:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781895.359781:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023747840:0@lo:400:kworker.0 00000100:00100000:2.0:1787781895.359816:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023747456:0@lo:400:kworker.0 00000100:00100000:3.0:1787781895.360051:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023747584:0@lo:400:kworker.0 00000100:00100000:3.0:1787781895.360090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781895.360120:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781895.360126:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023747712:0@lo:400:kworker.0 00000100:00100000:3.0:1787781895.360153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781895.360277:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023747328 00000100:00100000:0.0:1787781895.360283:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023747328 00000100:00100000:0.0:1787781895.360325:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787781895.360332:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023747328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781895.360387:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023747328:12345-0@lo:400:kworker.0 Request processed in 56us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781895.360394:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787781895.360437:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023747584 00000100:00100000:0.0:1787781895.360440:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023747584 00000100:00100000:0.0:1787781895.360466:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787781895.360472:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023747584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781895.360509:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023747584:12345-0@lo:400:kworker.0 Request processed in 37us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781895.360516:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787781895.360536:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023747712 00000100:00100000:0.0:1787781895.360539:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023747712 00000100:00100000:0.0:1787781895.360569:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787781895.360576:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023747712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781895.360608:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023747712:12345-0@lo:400:kworker.0 Request processed in 33us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781895.360627:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787781895.360666:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44a7612c0 x1874625023747712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781895.360678:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023747712:0@lo:400:kworker.0 00000100:00100000:0.0:1787781895.360689:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023747584:0@lo:400:kworker.0 00000100:00080000:2.0:1787781895.361591:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781895.361598:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781895.361999:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023747328:0@lo:400:kworker.0 00010000:00010000:2.0:1787781895.423588:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781895.873185:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781895.873214:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023747968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781895.873305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781895.873541:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023747968 00000100:00100000:0.0:1787781895.873552:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023747968 00000100:00100000:0.0:1787781895.873614:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787781895.873624:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023747968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781895.873674:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781895.873728:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023747968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781895.873736:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787781895.873816:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478e4cf00 x1874625023747968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781895.873839:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023747968:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787781896.446028:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781897.470461:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781898.494001:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787781898.548499:0:10132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:04:58 (1787781898) === 00000100:00100000:1.0:1787781898.980915:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781898.980993:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005888768 00000100:00100000:3.0:1787781898.981006:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005888768 00000100:00100000:3.0:1787781898.981134:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:3.0:1787781898.981147:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:8133:x1874625005888768:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787781898.981170:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781898.981209:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482044800/0x3ad9816c90454085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d842 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781898.981246:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482044800/0x3ad9816c90454085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d842 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781898.981273:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482044800/0x3ad9816c90454085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d842 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781898.981284:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044800, rc 0) 00000100:00100000:3.0:1787781898.981371:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8133:x1874625005888768:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 219us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781898.981379:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:1.0:1787781898.988608:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781898.988775:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005888896 00000100:00100000:0.0:1787781898.988828:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005888896 00000100:00100000:0.0:1787781898.988908:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:0.0:1787781898.988920:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8133:x1874625005888896:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787781898.989370:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8133:x1874625005888896:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 448us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781898.989388:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:1.0:1787781899.004544:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781899.004859:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005889024 00000100:00100000:3.0:1787781899.004874:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005889024 00000100:00100000:3.0:1787781899.004958:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00100000:3.0:1787781899.004971:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8133:x1874625005889024:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787781899.005284:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8133:x1874625005889024:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 314us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781899.005293:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00100000:1.0:1787781899.017166:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781899.017761:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005889152 00000100:00100000:2.0:1787781899.017776:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005889152 00000100:00100000:2.0:1787781899.017884:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:2.0:1787781899.017897:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8137:x1874625005889152:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787781899.018309:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8137:x1874625005889152:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 413us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781899.018317:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:2.0:1787781899.054962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781899.055346:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005889280 00000100:00100000:0.0:1787781899.055359:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005889280 00000100:00100000:0.0:1787781899.055424:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:0.0:1787781899.055434:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8137:x1874625005889280:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787781899.056352:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8137:x1874625005889280:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 912us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781899.056363:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:0.0:1787781899.068602:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781899.068707:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005889408 00000100:00100000:3.0:1787781899.068721:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005889408 00000100:00100000:3.0:1787781899.068846:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:3.0:1787781899.068860:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:8133:x1874625005889408:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787781899.068887:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781899.068921:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482044c00/0x3ad9816c9045408c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d86c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781899.068994:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482044c00/0x3ad9816c9045408c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d86c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781899.069007:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482044c00/0x3ad9816c9045408c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d86c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781899.069019:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044c00, rc 0) 00000100:00100000:3.0:1787781899.069300:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:8133:x1874625005889408:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 442us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781899.069310:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:1.0:1787781899.074628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781899.074703:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005889536 00000100:00100000:0.0:1787781899.074716:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005889536 00000100:00100000:0.0:1787781899.074817:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00100000:0.0:1787781899.074829:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:8133:x1874625005889536:12345-192.168.202.56@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787781899.074869:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787781899.074902:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787781899.074907:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787781899.074910:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787781899.074912:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787781899.077762:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:8133:x1874625005889536:12345-192.168.202.56@tcp:256:mount.lustre.0 Request processed in 2917us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781899.077781:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00100000:1.0:1787781899.081321:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781899.081420:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005889664 00000100:00100000:3.0:1787781899.081434:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005889664 00000100:00100000:3.0:1787781899.081523:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 214 00000100:00100000:3.0:1787781899.081536:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:8133:x1874625005889664:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787781899.081559:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781899.081616:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d873 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781899.081656:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d873 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781899.081670:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d873 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781899.081681:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2000, rc 0) 00000100:00100000:3.0:1787781899.081759:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:8133:x1874625005889664:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 225us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781899.081778:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 214 00000100:00100000:1.0:1787781899.088014:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781899.088126:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005889792 00000100:00100000:0.0:1787781899.088139:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005889792 00000100:00100000:0.0:1787781899.088217:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 215 00000100:00100000:0.0:1787781899.088229:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:8133:x1874625005889792:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787781899.088615:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:8133:x1874625005889792:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 388us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781899.088624:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 215 00000100:00100000:1.0:1787781899.091350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781899.091468:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005889920 00000100:00100000:2.0:1787781899.091480:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005889920 00000100:00100000:2.0:1787781899.091544:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:2.0:1787781899.091554:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:8133:x1874625005889920:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787781899.091907:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:8133:x1874625005889920:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 352us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781899.091915:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:1.0:1787781899.099058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781899.099167:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005890048 00000100:00100000:3.0:1787781899.099180:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005890048 00000100:00100000:3.0:1787781899.099257:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:3.0:1787781899.099269:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:8140:x1874625005890048:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787781899.099645:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:8140:x1874625005890048:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 377us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781899.099654:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:3.0:1787781899.105372:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781899.105597:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005890176 00000100:00100000:0.0:1787781899.105611:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005890176 00000100:00100000:0.0:1787781899.105678:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:0.0:1787781899.105688:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:8140:x1874625005890176:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787781899.106067:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:8140:x1874625005890176:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 379us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781899.106076:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:1.0:1787781899.115450:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781899.115507:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781899.115769:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005890304 00000100:00100000:3.0:1787781899.115782:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005890304 00000100:00100000:3.0:1787781899.115880:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005890688 00000100:00100000:3.0:1787781899.115884:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005890688 00000100:00100000:2.0:1787781899.116040:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1787781899.116052:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2348:x1874625005890304:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787781899.116093:0:9081:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ebbe214e-e8d4-40d1-ac9b-0939da433eb8@192.168.202.56@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1787781899.116141:0:9081:0:(genops.c:1385:class_connect()) connect: client ebbe214e-e8d4-40d1-ac9b-0939da433eb8, cookie 0x3ad9816c9045409a 00000004:00100000:2.0:1787781899.116182:0:9081:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787781899.116523:0:9081:0:(import.c:65:import_set_state_nolock()) ffff9ef47b2cc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787781899.116611:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:2348:x1874625005890304:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 558us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781899.116620:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1787781899.116736:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:3.0:1787781899.116744:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005890688:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781899.116779:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005890688:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781899.116880:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00080000:2.0:1787781899.117514:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781899.120318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781899.120439:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005890560 00000100:00100000:2.0:1787781899.120451:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005890560 00000100:00100000:2.0:1787781899.120549:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:2.0:1787781899.120562:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:8133:x1874625005890560:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787781899.120619:0:9081:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787781899.121019:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:8133:x1874625005890560:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 458us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781899.121029:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00080000:0.0:1787781899.121148:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781899.122720:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781899.124513:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005890432 00000100:00100000:0.0:1787781899.124530:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005890432 00000100:00100000:0.0:1787781899.124665:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:0.0:1787781899.124676:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:0:x1874625005890432:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787781899.124717:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787781899.124839:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:0:x1874625005890432:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 164us (2130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781899.124847:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:3.0:1787781899.125282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781899.129486:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005890816 00000100:00100000:2.0:1787781899.129507:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005890816 00000100:00100000:2.0:1787781899.129609:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:2.0:1787781899.129623:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:8133:x1874625005890816:12345-192.168.202.56@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787781899.129752:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:8133:x1874625005890816:12345-192.168.202.56@tcp:40:mount.lustre.0 Request processed in 131us (4472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781899.129761:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:1.0:1787781899.132109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781899.132155:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781899.132198:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781899.132414:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005891200 00000100:00100000:0.0:1787781899.132424:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005891200 00000100:00100000:0.0:1787781899.132479:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:0.0:1787781899.132487:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:8133:x1874625005891200:12345-192.168.202.56@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787781899.132759:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787781899.132957:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:8133:x1874625005891200:12345-192.168.202.56@tcp:33:mount.lustre.0 Request processed in 468us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781899.132984:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:2.0:1787781899.133611:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005890944 00000100:00100000:2.0:1787781899.133617:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005890944 00000100:00100000:2.0:1787781899.133647:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005891072 00000100:00100000:2.0:1787781899.133648:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005891072 00000100:00100000:2.0:1787781899.133669:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:2.0:1787781899.133673:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874625005890944:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787781899.133701:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ebbe214e-e8d4-40d1-ac9b-0939da433eb8@192.168.202.56@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1787781899.133731:0:6697:0:(genops.c:1385:class_connect()) connect: client ebbe214e-e8d4-40d1-ac9b-0939da433eb8, cookie 0x3ad9816c904540a1 00002000:00100000:2.0:1787781899.133744:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ebbe214e-e8d4-40d1-ac9b-0939da433eb8/ffff9ef47b2cd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787781899.133769:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787781899.134029:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787781899.134067:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9ef480a1c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781899.134084:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:3.0:1787781899.134091:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1874625005891072:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787781899.134108:0:8308:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ebbe214e-e8d4-40d1-ac9b-0939da433eb8@192.168.202.56@tcp t0 exp 0000000000000000 cur 266 last 0 00000100:00100000:2.0:1787781899.134120:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:2348:x1874625005890944:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 445us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781899.134127:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000020:00000080:3.0:1787781899.134139:0:8308:0:(genops.c:1385:class_connect()) connect: client ebbe214e-e8d4-40d1-ac9b-0939da433eb8, cookie 0x3ad9816c904540a8 00002000:00100000:3.0:1787781899.134144:0:8308:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ebbe214e-e8d4-40d1-ac9b-0939da433eb8/ffff9ef4809ab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787781899.134287:0:8308:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787781899.134444:0:8308:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787781899.134977:0:8308:0:(import.c:65:import_set_state_nolock()) ffff9ef4809ad000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781899.135027:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:2348:x1874625005891072:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 933us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781899.135035:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00010000:00010000:2.0:1787781899.524663:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787781899.550917:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ebbe214e-e8d4-40d1-ac9b-0939da433eb8 00000100:00100000:1.0:1787781900.482280:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781900.482309:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023748096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781900.482400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781900.485276:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023748608:0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781900.485404:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787781900.485408:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023748224:0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781900.485455:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023748736:0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781900.485494:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023748352:0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485508:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781900.485520:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781900.485523:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023748480:0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485535:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781900.485568:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023748608 00000100:00100000:0.0:1787781900.485576:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023748608 00000100:00100000:0.0:1787781900.485628:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787781900.485635:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023748608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485682:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023748608:12345-0@lo:400:kworker.0 Request processed in 47us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781900.485687:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787781900.485706:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023748224 00000100:00100000:0.0:1787781900.485709:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023748224 00000100:00100000:0.0:1787781900.485725:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787781900.485728:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023748224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485748:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023748224:12345-0@lo:400:kworker.0 Request processed in 19us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781900.485758:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787781900.485783:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023748736 00000100:00100000:0.0:1787781900.485807:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023748736 00000100:00100000:0.0:1787781900.485828:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023748352 00000100:00100000:0.0:1787781900.485829:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023748352 00000100:00100000:0.0:1787781900.485837:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023748480 00000100:00100000:0.0:1787781900.485838:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023748480 00000100:00100000:0.0:1787781900.485847:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787781900.485851:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023748736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485872:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023748736:12345-0@lo:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781900.485877:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787781900.485883:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787781900.485886:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023748352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485908:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023748352:12345-0@lo:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781900.485913:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787781900.485923:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787781900.485929:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023748480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.485967:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023748480:12345-0@lo:400:kworker.0 Request processed in 39us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781900.485974:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787781900.485997:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781900.486002:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781900.486031:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023748224:0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.486041:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023748736:0@lo:400:kworker.0 00010000:00080000:0.0:1787781900.486057:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480a06940 x1874625023748608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781900.486068:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023748608:0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.486121:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023748480:0@lo:400:kworker.0 00000100:00100000:0.0:1787781900.486128:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023748352:0@lo:400:kworker.0 00000100:00100000:3.0:1787781900.486497:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023748096 00000100:00100000:3.0:1787781900.486502:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023748096 00000100:00100000:3.0:1787781900.486641:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787781900.486648:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023748096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781900.486681:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781900.486732:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023748096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (4332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781900.486736:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787781900.489744:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb70c0 x1874625023748096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781900.489772:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023748096:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787781900.490837:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787781900.547125:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781900.990013:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781900.992139:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023748864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781900.992432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781900.993175:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023748864 00000100:00100000:0.0:1787781900.993187:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023748864 00000100:00100000:0.0:1787781900.993269:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787781900.994710:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023748864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781900.994768:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781900.994901:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023748864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 212us (2469us total) trans 0 rc 0/0 00010000:00080000:3.0:1787781900.994999:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478e4da40 x1874625023748864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781900.995028:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023748864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781901.000353:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1787781901.572656:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781902.597450:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787781902.601663:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ebbe214e-e8d4-40d1-ac9b-0939da433eb8 00010000:00010000:0.0:1787781903.614239:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787781903.614766:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ebbe214e-e8d4-40d1-ac9b-0939da433eb8 00000100:00100000:0.0:1787781904.325039:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781904.325128:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005891328 00000100:00100000:3.0:1787781904.325141:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005891328 00000100:00100000:3.0:1787781904.325214:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 220 00000100:00100000:3.0:1787781904.325226:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005891328:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781904.325328:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005891328:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 104us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781904.325337:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 220 00000100:00100000:2.0:1787781904.325892:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781904.325941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781904.327177:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005891584 00000100:00100000:3.0:1787781904.327190:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005891584 00000100:00100000:3.0:1787781904.327284:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1787781904.327295:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005891584:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781904.327384:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005891584:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 91us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781904.327391:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1787781904.327416:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005891840 00000100:00100000:3.0:1787781904.327419:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005891840 00000100:00100000:3.0:1787781904.327443:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:3.0:1787781904.327450:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a763c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005891840:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781904.327472:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a763c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005891840:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781904.327478:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00080000:0.0:1787781904.327532:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781904.327538:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781904.334168:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781904.334224:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781904.334264:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005891712 00000100:00100000:0.0:1787781904.334277:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005891712 00000100:00100000:0.0:1787781904.334353:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:0.0:1787781904.334366:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005891712:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781904.334460:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005891712:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781904.334477:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00080000:0.0:1787781904.334509:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781904.337726:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005891456 00000100:00100000:1.0:1787781904.337828:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005891456 00000100:00100000:1.0:1787781904.342132:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:1.0:1787781904.342150:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005891456:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781904.342267:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005891456:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 122us (8113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781904.342276:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00080000:0.0:1787781904.343506:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787781904.365333:0:10329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787781904.641216:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781905.598195:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023748992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781905.598296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781905.599443:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023748992 00000100:00100000:1.0:1787781905.599458:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023748992 00000100:00100000:1.0:1787781905.599543:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787781905.599558:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023748992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781905.599579:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023749120:0@lo:400:kworker.0 00002000:00000024:1.0:1787781905.599609:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781905.599650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781905.599671:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023748992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781905.599680:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787781905.599694:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023749632:0@lo:400:kworker.0 00000100:00080000:1.0:1787781905.599709:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787781905.599724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781905.599738:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023749376:0@lo:400:kworker.0 00000100:00100000:3.0:1787781905.599749:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781905.599758:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023749248:0@lo:400:kworker.0 00000100:00100000:1.0:1787781905.599775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781905.599816:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023749120 00000100:00100000:3.0:1787781905.599821:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023749120 00000100:00100000:3.0:1787781905.599854:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787781905.599861:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023749120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781905.599942:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023749632 00000100:00100000:2.0:1787781905.599947:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023749632 00000100:00100000:2.0:1787781905.599990:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023749376 00000100:00100000:2.0:1787781905.599993:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023749376 00000100:00100000:2.0:1787781905.600022:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787781905.600030:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023749632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781905.600536:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023749120:12345-0@lo:400:kworker.0 Request processed in 673us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781905.600539:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023749632:12345-0@lo:400:kworker.0 Request processed in 508us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781905.600552:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787781905.600553:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787781905.600582:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787781905.600592:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023749376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781905.600619:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023749504:0@lo:400:kworker.0 00000100:00100000:2.0:1787781905.600629:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023749376:12345-0@lo:400:kworker.0 Request processed in 40us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781905.600637:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787781905.600659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787781905.600668:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787781905.600706:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb7840 x1874625023748992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781905.600730:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023748992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781905.600763:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023749504 00000100:00100000:3.0:1787781905.600768:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023749504 00000100:00100000:3.0:1787781905.600842:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787781905.600850:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023749504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781905.600909:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023749504:12345-0@lo:400:kworker.0 Request processed in 59us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781905.600917:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787781905.600947:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023749376:0@lo:400:kworker.0 00010000:00080000:3.0:1787781905.600954:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb6580 x1874625023749504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781905.600967:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023749504:0@lo:400:kworker.0 00000100:00100000:1.0:1787781905.600976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781905.601007:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023749120:0@lo:400:kworker.0 00000100:00100000:1.0:1787781905.601017:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023749632:0@lo:400:kworker.0 00000100:00100000:1.0:1787781905.601038:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023749248 00000100:00100000:1.0:1787781905.601042:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023749248 00000100:00100000:1.0:1787781905.601066:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787781905.601073:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023749248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781905.601118:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023749248:12345-0@lo:400:kworker.0 Request processed in 45us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781905.601125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787781905.601180:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781905.602407:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023749248:0@lo:400:kworker.0 00010000:00010000:0.0:1787781905.670316:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781906.117573:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781906.117608:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023749760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781906.117710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781906.117911:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023749760 00000100:00100000:1.0:1787781906.117922:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023749760 00000100:00100000:1.0:1787781906.118001:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787781906.118012:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023749760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781906.118068:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781906.118123:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023749760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781906.118129:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787781906.118373:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478e4cb40 x1874625023749760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781906.118412:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023749760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787781906.698469:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781907.710349:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781908.734221:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781909.448962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781909.449016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781909.449055:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781909.449091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781909.449122:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005891968 00000100:00100000:3.0:1787781909.449139:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005891968 00000100:00100000:0.0:1787781909.449168:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781909.449201:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005892096 00000100:00100000:0.0:1787781909.449205:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005892096 00000100:00100000:3.0:1787781909.449232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:3.0:1787781909.449247:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005891968:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781909.449270:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005892224 00000100:00100000:0.0:1787781909.449275:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005892224 00000100:00100000:0.0:1787781909.449300:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:0.0:1787781909.449309:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005892096:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781909.449342:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005891968:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 99us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781909.449351:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005892096:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 41us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781909.449355:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:0.0:1787781909.449365:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:0.0:1787781909.449400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:0.0:1787781909.449408:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005892224:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781909.449433:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005892352 00000100:00100000:0.0:1787781909.449434:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005892224:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781909.449440:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005892352 00000100:00100000:0.0:1787781909.449444:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:3.0:1787781909.449477:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005892480 00000100:00100000:3.0:1787781909.449481:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005892480 00000100:00100000:3.0:1787781909.449521:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:3.0:1787781909.449532:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005892352:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781909.449565:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005892352:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781909.449571:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:3.0:1787781909.449583:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:3.0:1787781909.449589:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005892480:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:2.0:1787781909.449784:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787781909.449815:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787781909.449818:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781909.450092:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005892480:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781909.450103:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00010000:00010000:0.0:1787781909.764143:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781910.718855:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781910.718888:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023749888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781910.719007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.722297:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023749888 00000100:00100000:1.0:1787781910.722316:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023749888 00000100:00100000:1.0:1787781910.722394:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787781910.722403:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023749888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781910.722456:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781910.722575:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023749888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.722583:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787781910.722816:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787781910.722877:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb7840 x1874625023749888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781910.722902:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023749888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781910.723034:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023750144:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.723117:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781910.723123:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023750272:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.723182:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023750144 00000100:00100000:1.0:1787781910.723186:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023750144 00000100:00100000:1.0:1787781910.723218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023750272 00000100:00100000:1.0:1787781910.723221:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023750272 00000100:00100000:1.0:1787781910.723248:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787781910.723256:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023750144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723300:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023750144:12345-0@lo:400:kworker.0 Request processed in 45us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.723307:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787781910.723320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787781910.723326:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023750272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723353:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023750272:12345-0@lo:400:kworker.0 Request processed in 28us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.723359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787781910.723397:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023750400:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.723459:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787781910.723465:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023750016:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723494:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.723523:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023750528:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723544:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781910.723570:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023750016 00000100:00100000:1.0:1787781910.723574:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023750016 00000100:00100000:1.0:1787781910.723602:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787781910.723610:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023750016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723647:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023750016:12345-0@lo:400:kworker.0 Request processed in 38us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.723653:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:1.0:1787781910.723681:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781910.723702:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023750272:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723713:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023750144:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723743:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023750016:0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723757:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023750528 00000100:00100000:1.0:1787781910.723760:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023750528 00000100:00100000:1.0:1787781910.723808:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787781910.723817:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023750528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.723860:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023750528:12345-0@lo:400:kworker.0 Request processed in 44us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781910.723867:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787781910.723895:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781910.724388:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023750400 00000100:00100000:0.0:1787781910.724393:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023750400 00000100:00100000:0.0:1787781910.724437:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787781910.724459:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023750400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781910.724476:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023750528:0@lo:400:kworker.0 00000100:00080000:1.0:1787781910.724495:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781910.724519:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023750400:12345-0@lo:400:kworker.0 Request processed in 76us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781910.724525:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787781910.724650:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef473fe0b40 x1874625023750400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781910.724676:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023750400:0@lo:400:kworker.0 00010000:00010000:3.0:1787781910.783691:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781911.245158:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023750656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781911.245258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781911.245352:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023750656 00000100:00100000:0.0:1787781911.245363:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023750656 00000100:00100000:0.0:1787781911.245422:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787781911.245434:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023750656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781911.245483:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781911.245535:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023750656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781911.245543:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787781911.245604:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478e4cb40 x1874625023750656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781911.245626:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023750656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781911.806577:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781912.829973:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781913.854225:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781914.566188:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781914.568124:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781914.568176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781914.568257:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781914.568328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781914.568407:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005892608 00000100:00100000:1.0:1787781914.568420:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005892608 00000100:00100000:1.0:1787781914.568504:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:1.0:1787781914.568532:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005892608:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781914.568662:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005892608:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 149us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781914.568671:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:1.0:1787781914.568713:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005892864 00000100:00100000:1.0:1787781914.568717:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005892864 00000100:00100000:1.0:1787781914.568769:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005892736 00000100:00100000:1.0:1787781914.568773:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005892736 00000100:00100000:1.0:1787781914.568836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:1.0:1787781914.568843:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005892864:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781914.568925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005892864:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 63us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781914.568932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:1.0:1787781914.568959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:1.0:1787781914.568966:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005892736:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781914.569056:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005892736:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 91us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781914.569063:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:1.0:1787781914.569082:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005893120 00000100:00100000:1.0:1787781914.569086:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005893120 00000100:00100000:1.0:1787781914.569113:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005892992 00000100:00100000:1.0:1787781914.569116:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005892992 00000100:00100000:1.0:1787781914.569137:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:1.0:1787781914.569144:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005893120:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781914.569175:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005893120:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781914.569182:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:1.0:1787781914.569210:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:1.0:1787781914.569236:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005892992:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781914.569276:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005892992:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781914.569302:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00080000:1.0:1787781914.569670:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787781914.569676:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781914.569679:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787781914.888443:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781915.838311:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023750912:0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.838312:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023751168:0@lo:400:kworker.0 00000100:00100000:1.0:1787781915.838383:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476778f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023750784:0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.838906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781915.839089:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023751168 00000100:00100000:3.0:1787781915.839098:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023751168 00000100:00100000:3.0:1787781915.839275:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787781915.839286:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023751168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.839349:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023751168:12345-0@lo:400:kworker.0 Request processed in 65us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781915.839356:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787781915.839416:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787781915.839453:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47677b480 x1874625023751168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781915.839484:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023751168:0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.839855:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4767792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023751040:0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.839896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781915.839930:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023751552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781915.839957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781915.840093:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023751040 00000100:00100000:3.0:1787781915.840098:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023751040 00000100:00100000:3.0:1787781915.840267:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787781915.840277:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023751040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781915.840320:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023751040:12345-0@lo:400:kworker.0 Request processed in 46us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781915.840327:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787781915.840448:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4767792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023751040:0@lo:400:kworker.0 00000100:00080000:0.0:1787781915.840472:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781915.840567:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023751552 00000100:00100000:3.0:1787781915.840572:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023751552 00000100:00100000:3.0:1787781915.840612:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787781915.840618:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023751552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781915.840654:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781915.840691:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023751552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781915.840697:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787781915.840823:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787781915.840844:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef480bb7c00 x1874625023751552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781915.840862:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023751552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781915.849827:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781915.851895:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023750912 00000100:00100000:0.0:1787781915.851913:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023750912 00000100:00100000:0.0:1787781915.852009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787781915.852023:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023750912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.853446:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023750912:12345-0@lo:400:kworker.0 Request processed in 1416us (3647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781915.853460:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787781915.853759:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023750912:0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.853776:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023751424:0@lo:400:kworker.0 00000100:00100000:2.0:1787781915.853847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781915.856988:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023751424 00000100:00100000:0.0:1787781915.857009:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023751424 00000100:00100000:0.0:1787781915.857330:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787781915.857344:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023751424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781915.857635:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023751424:12345-0@lo:400:kworker.0 Request processed in 295us (3788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781915.857656:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787781915.859276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781915.859341:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023750784 00000100:00100000:1.0:1787781915.859350:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023750784 00000100:00100000:1.0:1787781915.859416:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787781915.859435:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023750784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781915.859492:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023750784:12345-0@lo:400:kworker.0 Request processed in 61us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781915.859500:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787781915.859584:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476778f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023750784:0@lo:400:kworker.0 00000100:00100000:1.0:1787781915.859600:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47677bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023751296:0@lo:400:kworker.0 00000100:00100000:1.0:1787781915.859635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781915.859665:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023751296 00000100:00100000:1.0:1787781915.859668:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023751296 00000100:00100000:1.0:1787781915.859708:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787781915.859715:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023751296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781915.859748:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023751296:12345-0@lo:400:kworker.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781915.859755:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787781915.859783:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47677bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023751296:0@lo:400:kworker.0 00000100:00080000:0.0:1787781915.860044:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787781915.862914:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478e4cb40 x1874625023751424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781915.862936:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023751424:0@lo:400:kworker.0 00010000:00010000:3.0:1787781915.904322:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781916.350829:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023751680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781916.350939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781916.351579:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023751680 00000100:00100000:0.0:1787781916.351590:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023751680 00000100:00100000:0.0:1787781916.351648:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787781916.351658:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023751680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781916.351717:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781916.351816:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023751680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781916.351825:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787781916.353175:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478a7a1c0 x1874625023751680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781916.353205:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023751680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781916.938051:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781917.964990:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781918.978974:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781919.686991:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781919.687037:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781919.687062:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781919.687081:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781919.687170:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781919.687211:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005893632 00000100:00100000:1.0:1787781919.687224:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005893632 00000100:00100000:1.0:1787781919.687302:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005893760 00000100:00100000:1.0:1787781919.687318:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005893760 00000100:00100000:1.0:1787781919.687351:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1787781919.687363:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2348:x1874625005893632:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:1.0:1787781919.687403:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c904540a1 00000100:00080000:1.0:1787781919.687416:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ef480a1c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787781919.687462:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787781919.688032:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+2:2348:x1874625005893632:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 668us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781919.688043:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1787781919.688063:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1787781919.688071:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2348:x1874625005893760:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:1.0:1787781919.688085:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c904540a8 00000100:00080000:1.0:1787781919.688091:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ef4809ad000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787781919.688116:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787781919.688310:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+2:2348:x1874625005893760:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 239us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781919.688317:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1787781919.688341:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005893248 00000100:00100000:1.0:1787781919.688345:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005893248 00000100:00100000:1.0:1787781919.688373:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:1.0:1787781919.688381:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2349:x1874625005893248:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781919.688408:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2349:x1874625005893248:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781919.688415:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:1.0:1787781919.688448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005893504 00000100:00100000:1.0:1787781919.688453:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005893504 00000100:00100000:1.0:1787781919.688498:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005893376 00000100:00100000:1.0:1787781919.688501:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005893376 00000100:00100000:1.0:1787781919.688524:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:1.0:1787781919.688531:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2349:x1874625005893504:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781919.690135:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2349:x1874625005893504:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1595us (3063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781919.690148:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:1.0:1787781919.690179:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:1.0:1787781919.690189:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2349:x1874625005893376:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781919.690219:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2349:x1874625005893376:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781919.690226:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00080000:1.0:1787781919.690261:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787781919.690268:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781919.690271:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787781919.690290:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781919.690467:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781920.003890:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787781920.006829:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ebbe214e-e8d4-40d1-ac9b-0939da433eb8 00000020:00000080:3.0:1787781920.006842:0:6719:0:(genops.c:885:class_export_put()) final put ffff9ef47b2cd800/ebbe214e-e8d4-40d1-ac9b-0939da433eb8 00000020:00000080:1.0:1787781920.006912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47b2cd800/ebbe214e-e8d4-40d1-ac9b-0939da433eb8 for lustre-OST0000 00000020:00000080:1.0:1787781920.006984:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef480a1c800 for lustre-OST0000 00000001:02000400:0.0:1787781920.938491:0:11030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787781920.962055:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023752064:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.962155:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781920.962231:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787781920.962237:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023751936:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.962261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781920.962279:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023752448:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.962327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781920.962380:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023752064 00000100:00100000:1.0:1787781920.962389:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023752064 00000100:00100000:1.0:1787781920.962450:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023751936 00000100:00100000:1.0:1787781920.962453:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023751936 00000100:00100000:1.0:1787781920.962477:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787781920.962488:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023752064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.962549:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023752064:12345-0@lo:400:kworker.0 Request processed in 63us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781920.962556:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787781920.962574:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787781920.962579:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023751936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781920.962835:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023751808:0@lo:400:kworker.0 00000100:00100000:3.0:1787781920.962876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781920.962905:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023752320:0@lo:400:kworker.0 00000100:00100000:3.0:1787781920.962929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781920.962943:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781920.962948:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023752192:0@lo:400:kworker.0 00000100:00100000:3.0:1787781920.962969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781920.962997:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023751808 00000100:00100000:3.0:1787781920.963001:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023751808 00000100:00100000:3.0:1787781920.963031:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787781920.963037:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023751808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781920.963073:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023751808:12345-0@lo:400:kworker.0 Request processed in 36us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781920.963079:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787781920.963111:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023752448 00000100:00100000:3.0:1787781920.963116:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023752448 00000100:00100000:3.0:1787781920.963144:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023752192 00000100:00100000:3.0:1787781920.963147:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023752192 00000100:00100000:3.0:1787781920.963168:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787781920.963175:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023752448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781920.963206:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023752448:12345-0@lo:400:kworker.0 Request processed in 32us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781920.963225:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787781920.963421:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787781920.963428:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023752192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781920.963457:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023752192:12345-0@lo:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781920.963463:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787781920.963506:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478dbf840 x1874625023752192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781920.963521:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023752192:0@lo:400:kworker.0 00000100:00100000:3.0:1787781920.963532:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023751808:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.963948:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023751936:12345-0@lo:400:kworker.0 Request processed in 1366us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781920.963956:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787781920.963973:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023752320 00000100:00100000:1.0:1787781920.963977:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023752320 00000100:00100000:1.0:1787781920.964000:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787781920.964007:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023752320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.964041:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023752320:12345-0@lo:400:kworker.0 Request processed in 35us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781920.964048:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787781920.964076:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787781920.964081:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787781920.964084:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781920.964107:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023752576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781920.964140:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781920.964172:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023751936:0@lo:400:kworker.0 00010000:00080000:1.0:1787781920.964199:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478dbcf00 x1874625023752448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781920.964208:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023752448:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.964220:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023752064:0@lo:400:kworker.0 00000100:00100000:1.0:1787781920.964249:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023752576 00000100:00100000:1.0:1787781920.964253:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023752576 00000100:00100000:1.0:1787781920.964279:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787781920.964286:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023752576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781920.964322:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781920.964360:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023752576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781920.964366:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787781920.964392:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478e4f0c0 x1874625023752576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781920.964406:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023752576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781920.965907:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023752320:0@lo:400:kworker.0 00010000:00010000:1.0:1787781921.024368:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781921.470172:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781921.470207:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023752704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781921.470307:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781921.470836:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023752704 00000100:00100000:1.0:1787781921.470849:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023752704 00000100:00100000:1.0:1787781921.470980:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787781921.470994:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023752704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781921.471044:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781921.471128:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023752704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781921.471136:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787781921.471239:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478a78b40 x1874625023752704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781921.471263:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023752704:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781922.049025:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787781923.065032:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ebbe214e-e8d4-40d1-ac9b-0939da433eb8 00000020:00000080:1.0:1787781923.065043:0:7652:0:(genops.c:885:class_export_put()) final put ffff9ef4809ab800/ebbe214e-e8d4-40d1-ac9b-0939da433eb8 00000020:00000080:3.0:1787781923.065689:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef4809ab800/ebbe214e-e8d4-40d1-ac9b-0939da433eb8 for lustre-OST0001 00000020:00000080:3.0:1787781923.065770:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef4809ad000 for lustre-OST0001 00010000:00010000:3.0:1787781923.071090:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781924.095013:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787781924.340861:0:11178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe672f6d10 20000000:00000080:2.0:1787781924.340890:0:11178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef478a21400 uarg=0000000000000000 20000000:01000000:2.0:1787781924.340941:0:11178:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787781924.340948:0:11178:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787781924.340953:0:11178:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787781924.341698:0:11179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787781924.341982:0:11178:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787781924.347962:0:11178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787781924.348101:0:11178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348127:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454054 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348161:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454062 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348168:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454070 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348179:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d83b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348187:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d873 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348195:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348255:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d873 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348275:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d873 expref: 12 pid: 5826 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781924.348294:0:11178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023752832:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781924.348447:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d83b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348456:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d83b expref: 12 pid: 5827 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781924.348465:0:11178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023752960:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781924.348510:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90454070 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348519:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90454070 expref: 18 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781924.348529:0:11178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023753088:0@lo:104: 00000100:00100000:2.0:1787781924.348639:0:11178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781924.348714:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90454062 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.348731:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90454062 expref: 18 pid: 5825 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781924.348741:0:11178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023753216:0@lo:104: 00000100:00100000:2.0:1787781924.348763:0:11178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781924.349267:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90454054 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781924.349278:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90454054 expref: 18 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781924.349288:0:11178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023753344:0@lo:104: 00000100:00100000:2.0:1787781924.349319:0:11178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781924.349645:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023753088 00000100:00100000:3.0:1787781924.349664:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023753088 00000100:00100000:3.0:1787781924.349727:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023753216 00000100:00100000:3.0:1787781924.349731:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023753216 00000100:00100000:3.0:1787781924.349751:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787781924.349761:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:11178:x1874625023753088:12345-0@lo:104: 00010000:00010000:3.0:1787781924.349777:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.349867:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787781924.349874:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:11178:x1874625023753088:12345-0@lo:104: Request processed in 114us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781924.349882:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787781924.349904:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787781924.349911:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:11178:x1874625023753216:12345-0@lo:104: 00010000:00010000:3.0:1787781924.349919:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.349952:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787781924.349957:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:11178:x1874625023753216:12345-0@lo:104: Request processed in 47us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781924.349963:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787781924.349980:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787781924.349987:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.349995:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045c00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:3.0:1787781924.350001:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.350022:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781924.350030:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781924.350036:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787781924.350072:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.350078:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781924.350104:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.350111:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482045c00/0x3ad9816c90454070 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90454077 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.350127:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781924.350131:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.350137:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:3.0:1787781924.350140:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.350146:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787781924.350153:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781924.350164:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787781924.350177:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.350182:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787781924.350199:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.350206:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef451414400/0x3ad9816c90454062 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90454069 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.350215:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781924.350216:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781924.350218:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781924.350243:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023753472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787781924.350281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781924.350327:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023753600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787781924.350351:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781924.350832:0:11178:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f5bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787781924.350861:0:11178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023753088:0@lo:104: 00000100:00100000:2.0:1787781924.350872:0:11178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023753216:0@lo:104: 00000100:00100000:3.0:1787781924.350951:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023753344 00000100:00100000:3.0:1787781924.350957:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023753344 00000100:00100000:3.0:1787781924.350986:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787781924.350993:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef46205b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:11178:x1874625023753344:12345-0@lo:104: 00010000:00010000:3.0:1787781924.351002:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.351057:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787781924.351063:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef46205b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:11178:x1874625023753344:12345-0@lo:104: Request processed in 70us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781924.351082:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787781924.351141:0:11178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023753344:0@lo:104: 00000100:00100000:3.0:1787781924.351534:0:11178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023752832:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781924.351543:0:11178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1874625023752960:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781924.351638:0:11178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.351867:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781924.351877:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.351886:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031800 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787781924.351891:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.351902:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781924.351911:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781924.351918:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787781924.351962:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.351969:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781924.351990:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.351998:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c90454054 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c9045405b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352018:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781924.352020:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781924.352032:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781924.352049:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023753728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781924.352098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781924.352157:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023753472 00000100:00100000:1.0:1787781924.352163:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023753472 00010000:00010000:1.0:1787781924.352188:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90454070 expref: 19 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781924.352214:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023753600 00000100:00100000:1.0:1787781924.352217:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023753600 00010000:00010000:1.0:1787781924.352248:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90454062 expref: 20 pid: 5825 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781924.352260:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023753728 00000100:00100000:1.0:1787781924.352263:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023753728 00010000:00010000:1.0:1787781924.352276:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90454054 expref: 21 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781924.352289:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781924.352295:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450cab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9f3bcc54-cf30-454f-ba67-121e6963b1be+21:3306:x1874625023753472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787781924.352309:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781924.352314:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90454070 expref: 21 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352325:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90454070 expref: 21 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352340:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef451414600/0x3ad9816c90454077 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90454070 expref: 21 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352353:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781924.352392:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450cab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9f3bcc54-cf30-454f-ba67-121e6963b1be+20:3306:x1874625023753472:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781924.352400:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781924.352445:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787781924.352451:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023753600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787781924.352458:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781924.352462:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90454062 expref: 19 pid: 5825 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352470:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90454062 expref: 19 pid: 5825 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352481:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482044a00/0x3ad9816c90454069 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90454062 expref: 19 pid: 5825 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352490:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781924.352512:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:3303:x1874625023753600:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781924.352518:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787781924.352530:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787781924.352535:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:3304:x1874625023753728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787781924.352542:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781924.352546:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90454054 expref: 17 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352555:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90454054 expref: 17 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352638:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482045600/0x3ad9816c9045405b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90454054 expref: 17 pid: 5827 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781924.352654:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781924.352683:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3304:x1874625023753728:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781924.352689:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787781924.352711:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781924.353061:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023753472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781924.353105:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023753728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781924.353397:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781924.353620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781924.353696:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023753600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787781924.365289:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005893888 00000100:00100000:3.0:1787781924.365307:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005893888 00010000:00010000:3.0:1787781924.365368:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d873 expref: 13 pid: 5826 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781924.365413:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005894016 00000100:00100000:3.0:1787781924.365416:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005894016 00010000:00010000:3.0:1787781924.365428:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d83b expref: 14 pid: 5827 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781924.365443:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:3.0:1787781924.365452:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+14:2351:x1874625005893888:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781924.365470:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781924.365486:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d873 expref: 14 pid: 5826 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365502:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d873 expref: 14 pid: 5826 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365526:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef450ba2000/0x3ad9816c90454093 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d873 expref: 14 pid: 5826 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365568:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781924.365638:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005893888:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 185us (12243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781924.365646:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:3.0:1787781924.365667:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:3.0:1787781924.365673:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:2351:x1874625005894016:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781924.365680:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781924.365685:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d83b expref: 12 pid: 5827 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365695:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d83b expref: 12 pid: 5827 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365706:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482044200/0x3ad9816c9045407e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d83b expref: 12 pid: 5827 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365727:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365736:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365754:0:8462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365761:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365777:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365784:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365821:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781924.365826:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365835:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365850:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365862:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781924.365880:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:2351:x1874625005894016:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 207us (12261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781924.365886:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00010000:00010000:3.0:1787781924.365916:0:11178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365925:0:11178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781924.365931:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef451415200/0x3ad9816c904540af lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781924.805930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781924.806047:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005894144 00000100:00100000:1.0:1787781924.806059:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005894144 00000100:00100000:1.0:1787781924.806147:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:2.0:1787781924.806154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781924.806164:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:2351:x1874625005894144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781924.806257:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:2351:x1874625005894144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 97us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781924.806266:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:0.0:1787781924.806448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005894272 00000100:00100000:0.0:1787781924.806453:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005894272 00000100:00100000:0.0:1787781924.806513:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:0.0:1787781924.806521:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462058b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005894272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781924.806544:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781924.806561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462058b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005894272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 40us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781924.806569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:0.0:1787781924.806582:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005894400 00000100:00100000:0.0:1787781924.806586:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005894400 00000100:00100000:0.0:1787781924.806616:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:0.0:1787781924.806624:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef46205bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005894400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:1.0:1787781924.807880:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781924.808196:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef46205bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005894400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1565us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781924.808208:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 84 00010000:00010000:3.0:1787781925.118631:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781925.379508:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781925.380008:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005894528 00000100:00100000:3.0:1787781925.380027:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005894528 00000100:00100000:3.0:1787781925.380096:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:3.0:1787781925.380108:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:5590:x1874625005894528:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781925.380132:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781925.380156:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d89d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781925.380194:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d89d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781925.380208:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d89d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781925.380220:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2000, rc 0) 00000100:00100000:3.0:1787781925.380290:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005894528:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 184us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781925.380298:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:2.0:1787781925.411251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781925.411681:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005894656 00000100:00100000:1.0:1787781925.411695:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005894656 00000100:00100000:1.0:1787781925.411778:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:1.0:1787781925.411816:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005894656:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781925.412448:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005894656:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 657us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781925.412458:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:3.0:1787781925.418148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781925.420640:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005894784 00000100:00100000:1.0:1787781925.420717:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005894784 00000100:00100000:1.0:1787781925.421782:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:1.0:1787781925.421821:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005894784:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781925.422378:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005894784:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 558us (4243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781925.422388:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:2.0:1787781925.431210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781925.431946:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005894912 00000100:00100000:3.0:1787781925.431970:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005894912 00000100:00100000:3.0:1787781925.432039:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:3.0:1787781925.432052:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005894912:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781925.432073:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781925.432097:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8a4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781925.432135:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8a4 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781925.432165:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8a4 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781925.432350:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3c00, rc 0) 00000100:00100000:3.0:1787781925.432442:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005894912:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 392us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781925.432450:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:2.0:1787781925.435923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781925.436326:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005895040 00000100:00100000:1.0:1787781925.436338:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005895040 00000100:00100000:1.0:1787781925.436398:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:1.0:1787781925.436410:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005895040:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781925.437279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005895040:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 756us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781925.437291:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:0.0:1787781925.440532:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781925.440655:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005895168 00000100:00100000:1.0:1787781925.440676:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005895168 00000100:00100000:1.0:1787781925.440746:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:1.0:1787781925.440758:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005895168:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781925.441084:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005895168:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 328us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781925.441093:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:2.0:1787781926.080278:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023753856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781926.080370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781926.080455:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023753856 00000100:00100000:2.0:1787781926.080464:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023753856 00000100:00100000:2.0:1787781926.080531:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787781926.080543:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023753856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787781926.080585:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781926.080635:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023753856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781926.080643:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787781926.080666:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787781926.080712:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef462059a40 x1874625023753856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781926.080733:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef462059a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023753856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781926.084212:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023753984:0@lo:400:kworker.0 00000100:00100000:1.0:1787781926.084303:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781926.092970:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023753984 00000100:00100000:0.0:1787781926.092991:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023753984 00000100:00100000:0.0:1787781926.093078:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787781926.093090:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3306:x1874625023753984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.093894:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023754240:0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.093948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781926.093991:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781926.093998:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023754112:0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.094031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781926.095045:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3306:x1874625023753984:12345-0@lo:400:kworker.0 Request processed in 1953us (10737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781926.095062:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787781926.095122:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023754368:0@lo:400:kworker.0 00000100:00100000:0.0:1787781926.095164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781926.095204:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781926.095210:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023754496:0@lo:400:kworker.0 00000100:00100000:0.0:1787781926.095236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781926.095307:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023754368 00000100:00100000:2.0:1787781926.095317:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023754368 00000100:00100000:2.0:1787781926.095381:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787781926.095391:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023754368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.095443:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023754368:12345-0@lo:400:kworker.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781926.095450:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787781926.095487:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478e4f480 x1874625023754368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781926.095504:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023754368:0@lo:400:kworker.0 00000100:00100000:3.0:1787781926.095604:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023754240 00000100:00100000:3.0:1787781926.095609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023754240 00000100:00100000:3.0:1787781926.095681:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023754112 00000100:00100000:3.0:1787781926.095685:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023754112 00000100:00080000:0.0:1787781926.095730:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781926.095735:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781926.097028:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023753984:0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.097161:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023754496 00000100:00100000:2.0:1787781926.097166:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023754496 00000100:00100000:2.0:1787781926.097218:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787781926.097227:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023754240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.097310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023754240:12345-0@lo:400:kworker.0 Request processed in 86us (3363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781926.097317:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787781926.097333:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787781926.097341:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023754112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.097372:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023754112:12345-0@lo:400:kworker.0 Request processed in 32us (3340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781926.097378:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787781926.097389:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787781926.097395:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023754496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.097447:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023754496:12345-0@lo:400:kworker.0 Request processed in 52us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781926.097452:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1787781926.097469:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781926.097497:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023754112:0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.097510:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023754240:0@lo:400:kworker.0 00000100:00100000:2.0:1787781926.097542:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023754496:0@lo:400:kworker.0 00010000:00010000:3.0:1787781926.146436:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787781926.149860:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787781926.149870:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef444b97000 from 7 10000000:01000000:0.0:1787781926.149875:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787781926.149944:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781926.149960:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781926.149976:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781926.150010:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023754624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787781926.150108:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781926.150176:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781926.150254:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023754624 00000100:00100000:3.0:1787781926.150263:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023754624 00000100:00100000:3.0:1787781926.150334:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787781926.150344:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023754624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781926.150360:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781926.150376:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c904540c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781926.150404:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c904540c4 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781926.150416:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904540c4 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781926.150427:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2200, rc 0) 00000100:00100000:3.0:1787781926.150475:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023754624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781926.150491:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787781926.150543:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023754624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781926.150559:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781926.150568:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781926.150634:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023754752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781926.150660:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781926.150673:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787781926.150755:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023754752 00000100:00100000:0.0:1787781926.150760:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023754752 00000100:00100000:0.0:1787781926.150822:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787781926.150829:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023754752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781926.151123:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023754752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781926.151129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787781926.151266:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023754752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781926.151299:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023754880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781926.151341:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781926.151371:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787781926.151533:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023754880 00000100:00100000:0.0:1787781926.151538:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023754880 00000100:00100000:0.0:1787781926.151570:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787781926.151577:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023754880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781926.151755:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023754880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781926.151762:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787781926.151855:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023754880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787781926.153150:0:11235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787781926.155053:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787781926.155096:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781926.155112:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781926.155128:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781926.155141:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781926.155159:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef450a67000 from 7 10000000:01000000:3.0:1787781926.155163:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781926.155211:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781926.155219:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781926.155230:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781926.155259:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781926.155347:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781926.155461:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787781926.158872:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023755008 00000100:00100000:0.0:1787781926.158892:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023755008 00000100:00100000:1.0:1787781926.161954:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787781926.161972:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023755008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781926.161996:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781926.162021:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c904540d2 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.162061:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c904540d2 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.162075:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904540d2 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.162085:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef441480c00, rc 0) 00000100:00100000:1.0:1787781926.162194:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023755008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (6846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781926.162202:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787781926.162390:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781926.162413:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781926.162424:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781926.162512:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781926.162553:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781926.162594:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787781926.162647:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023755136 00000100:00100000:1.0:1787781926.162655:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023755136 00000100:00100000:1.0:1787781926.162690:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787781926.162698:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023755136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781926.167252:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023755136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4542us (4686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781926.167271:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787781926.167437:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781926.167512:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787781926.167570:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781926.167617:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451517cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781926.167672:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023755264 00000100:00100000:1.0:1787781926.167680:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023755264 00000100:00100000:1.0:1787781926.167742:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787781926.167753:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023755264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781926.167952:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023755264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781926.167959:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787781926.167997:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787781926.168662:0:11236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787781926.168728:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787781926.168753:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787781926.168766:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.168778:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781926.168811:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787781926.168815:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef4450df800 from 7 10000000:01000000:1.0:1787781926.168818:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787781926.168853:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.168861:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.168871:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781926.168888:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787781926.168940:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781926.168960:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef479103540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781926.168980:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023755392 00000100:00100000:1.0:1787781926.168985:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023755392 00000100:00100000:1.0:1787781926.169014:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787781926.169022:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023755392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781926.169034:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781926.169050:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c904540e0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.169076:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c904540e0 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.169088:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904540e0 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.169098:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef441481e00, rc 0) 00000100:00100000:1.0:1787781926.169128:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023755392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781926.169134:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787781926.169172:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781926.169186:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781926.169195:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781926.169239:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781926.169271:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781926.169284:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef479103540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781926.169294:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023755520 00000100:00100000:1.0:1787781926.169297:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023755520 00000100:00100000:1.0:1787781926.169317:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787781926.169322:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023755520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781926.169557:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023755520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781926.169564:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787781926.169591:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781926.169616:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781926.169654:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781926.169667:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef479103540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781926.169676:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023755648 00000100:00100000:1.0:1787781926.169679:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023755648 00000100:00100000:1.0:1787781926.169698:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787781926.169719:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023755648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781926.169878:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023755648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781926.169885:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787781926.169918:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023755648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787781926.178415:0:11237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787781926.179945:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787781926.179981:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787781926.179996:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781926.180011:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781926.600724:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023755776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781926.600856:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781926.602029:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023755776 00000100:00100000:2.0:1787781926.602042:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023755776 00000100:00100000:2.0:1787781926.602120:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787781926.602133:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023755776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781926.602179:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781926.606303:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023755776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4158us (5433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781926.606321:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787781926.608421:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478dbe1c0 x1874625023755776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781926.608460:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023755776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781927.166282:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781928.191350:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787781929.018643:0:11377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787781929.216956:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781929.936959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781929.936999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781929.937033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781929.937131:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005895424 00000100:00100000:0.0:1787781929.937141:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005895424 00000100:00100000:0.0:1787781929.937211:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005895552 00000100:00100000:0.0:1787781929.937215:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005895552 00000100:00100000:0.0:1787781929.937236:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:0.0:1787781929.937247:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005895424:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781929.937315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 89 00000100:00100000:3.0:1787781929.937338:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005895552:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781929.937529:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005895552:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 200us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781929.937559:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 89 00000100:00100000:0.0:1787781929.938625:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005895424:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1373us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781929.938637:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00080000:2.0:1787781929.938832:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781929.938914:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005895296 00000100:00100000:1.0:1787781929.938921:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005895296 00000100:00100000:1.0:1787781929.938987:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 245 00000100:00100000:1.0:1787781929.938996:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005895296:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781929.939060:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005895296:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 65us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781929.939067:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 245 00010000:00010000:1.0:1787781930.240135:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781931.198046:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781931.198071:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023755904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781931.198139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781931.199578:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023755904 00000100:00100000:3.0:1787781931.199590:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023755904 00000100:00100000:3.0:1787781931.199664:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787781931.199675:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023755904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781931.199714:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781931.199785:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023755904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781931.199808:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787781931.200020:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787781931.202250:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef4620583c0 x1874625023755904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781931.202277:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4620583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023755904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781931.202441:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023756416:0@lo:400:kworker.0 00000100:00100000:0.0:1787781931.202497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781931.202526:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781931.202532:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023756288:0@lo:400:kworker.0 00000100:00100000:0.0:1787781931.202571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781931.202603:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023756416 00000100:00100000:0.0:1787781931.202609:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023756416 00000100:00100000:0.0:1787781931.202671:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781931.202680:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023756416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781931.202725:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023756416:12345-0@lo:400:kworker.0 Request processed in 47us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781931.202732:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787781931.202755:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023756288 00000100:00100000:0.0:1787781931.202758:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023756288 00000100:00100000:0.0:1787781931.202784:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787781931.202819:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023756288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781931.202850:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023756288:12345-0@lo:400:kworker.0 Request processed in 59us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781931.202856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787781931.202878:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781931.202882:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781931.202901:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023756288:0@lo:400:kworker.0 00010000:00080000:0.0:1787781931.202912:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478a78f00 x1874625023756416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781931.202921:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023756416:0@lo:400:kworker.0 00000100:00100000:2.0:1787781931.203016:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023756032:0@lo:400:kworker.0 00000100:00100000:2.0:1787781931.203052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781931.203085:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023756544:0@lo:400:kworker.0 00000100:00100000:2.0:1787781931.203108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781931.203125:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781931.203139:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023756160:0@lo:400:kworker.0 00000100:00100000:2.0:1787781931.203159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781931.203181:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023756544 00000100:00100000:2.0:1787781931.203185:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023756544 00000100:00100000:2.0:1787781931.203208:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023756160 00000100:00100000:2.0:1787781931.203211:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023756160 00000100:00100000:2.0:1787781931.203226:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787781931.203232:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462059a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023756544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781931.203263:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462059a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023756544:12345-0@lo:400:kworker.0 Request processed in 32us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781931.203270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787781931.203290:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787781931.203296:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4620583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023756160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781931.203318:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4620583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023756160:12345-0@lo:400:kworker.0 Request processed in 23us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781931.203324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787781931.203338:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781931.203354:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023756160:0@lo:400:kworker.0 00000100:00100000:2.0:1787781931.203363:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023756544:0@lo:400:kworker.0 00000100:00100000:0.0:1787781931.203704:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023756032 00000100:00100000:0.0:1787781931.203709:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023756032 00000100:00100000:0.0:1787781931.203778:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787781931.203786:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023756032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781931.203846:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023756032:12345-0@lo:400:kworker.0 Request processed in 62us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781931.203858:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787781931.203918:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023756032:0@lo:400:kworker.0 00010000:00010000:1.0:1787781931.265174:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781931.728439:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023756672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781931.728531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781931.728665:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023756672 00000100:00100000:0.0:1787781931.728674:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023756672 00000100:00100000:0.0:1787781931.728740:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787781931.728749:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023756672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781931.728820:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781931.728888:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023756672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781931.728894:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787781931.728931:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478a78f00 x1874625023756672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781931.728949:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023756672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781932.286886:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787781933.311653:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781934.336511:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787781934.430660:0:11477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:05:33 (1787781933) === 00000100:00100000:3.0:1787781934.920851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781934.920938:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781934.921308:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005895808 00000100:00100000:1.0:1787781934.921317:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005895808 00000100:00100000:1.0:1787781934.921391:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:1.0:1787781934.921401:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:9684:x1874625005895808:12345-192.168.202.56@tcp:700:mkdir.0 00000100:00100000:1.0:1787781934.921495:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:9684:x1874625005895808:12345-192.168.202.56@tcp:700:mkdir.0 Request processed in 95us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781934.921502:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1787781934.921817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005895680 00000100:00100000:2.0:1787781934.921822:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005895680 00000100:00100000:2.0:1787781934.921860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:2.0:1787781934.921867:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005895680:12345-192.168.202.56@tcp:41:mkdir.0 00000004:00000024:2.0:1787781934.921895:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787781934.921967:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005895680:12345-192.168.202.56@tcp:41:mkdir.0 Request processed in 100us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781934.921975:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00080000:0.0:1787781934.922780:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781934.929850:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781934.929984:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005896064 00000100:00100000:2.0:1787781934.929994:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005896064 00000100:00100000:2.0:1787781934.930055:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:2.0:1787781934.930065:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:9684:x1874625005896064:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:2.0:1787781934.930128:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781934.930155:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90453fcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d826 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.930175:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787781934.930186:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781934.930532:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.930547:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.930558:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.930608:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.930616:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.930633:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781934.940233:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787781934.940255:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.940265:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.940273:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.940280:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781934.941098:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.941109:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.941127:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088a800) 00010000:00010000:2.0:1787781934.941131:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781934.941136:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.941142:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781934.941167:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004462ff3 reply state 00000000fb8c8821 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781934.941177:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781934.942464:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:9684:x1874625005896064:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 12390us (12613us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787781934.942502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00010000:00010000:1.0:1787781934.955360:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781934.955379:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781934.955387:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781934.955394:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781934.955399:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781934.955407:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781934.955440:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ef45088aa00) 00010000:00010000:1.0:1787781934.955443:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781934.955448:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781934.955455:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904540f5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781934.968147:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781934.968332:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005896192 00000100:00100000:2.0:1787781934.968341:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005896192 00000100:00100000:2.0:1787781934.968407:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:2.0:1787781934.968418:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef460d60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:9686:x1874625005896192:12345-192.168.202.56@tcp:101:chmod.0 00010000:00010000:2.0:1787781934.968452:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781934.968487:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8ab expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.968552:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454103 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.968566:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.968577:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781934.968654:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787781934.968658:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781934.968698:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.968723:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904540fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ab expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.968742:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ab expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.968769:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088a800) 00010000:00010000:2.0:1787781934.968772:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781934.968776:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:2.0:1787781934.968871:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef460d60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:9686:x1874625005896192:12345-192.168.202.56@tcp:101:chmod.0 Request processed in 455us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781934.968878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1787781934.975784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781934.976443:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005896448 00000100:00100000:1.0:1787781934.976451:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005896448 00000100:00100000:1.0:1787781934.976535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1787781934.976542:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:9686:x1874625005896448:12345-192.168.202.56@tcp:36:chmod.0 00010000:00010000:1.0:1787781934.976593:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781934.976616:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454103 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ab expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781934.976640:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088a800) 00010000:00010000:1.0:1787781934.976649:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781934.976669:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781934.976679:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781934.976686:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781934.976994:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbb43aa4 reply state 0000000040f3a423 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781934.977014:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787781934.977030:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787781934.977706:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:9686:x1874625005896448:12345-192.168.202.56@tcp:36:chmod.0 Request processed in 1161us (1929us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787781934.977715:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00010000:00010000:3.0:1787781934.980830:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781934.980845:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781934.980852:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781934.980858:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781934.980863:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781934.980883:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781934.980899:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467900) 00010000:00010000:3.0:1787781934.980902:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787781934.980907:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781934.980913:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c9045410a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781934.998934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781934.999470:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005896576 00000100:00100000:2.0:1787781934.999480:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005896576 00000100:00100000:2.0:1787781934.999534:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1787781934.999542:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:9687:x1874625005896576:12345-192.168.202.56@tcp:101:chown.0 00010000:00010000:2.0:1787781934.999561:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781934.999579:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8b2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.999642:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454118 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.999656:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.999666:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781934.999723:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787781934.999728:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781934.999766:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.999852:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8b2 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.999872:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454118 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8b2 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781934.999881:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787781934.999884:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781934.999888:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415000, rc 0) 00000100:00100000:2.0:1787781934.999951:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:9687:x1874625005896576:12345-192.168.202.56@tcp:101:chown.0 Request processed in 408us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781934.999958:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:0.0:1787781935.003088:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781935.003131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005896704 00000100:00100000:2.0:1787781935.003151:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005896704 00000100:00100000:2.0:1787781935.003212:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:2.0:1787781935.003223:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:9687:x1874625005896704:12345-192.168.202.56@tcp:101:chown.0 00010000:00010000:2.0:1787781935.003242:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781935.003262:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045411f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8b9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.003325:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.003339:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.003861:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.003894:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.003902:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.003909:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004020:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004029:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004047:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781935.004089:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787781935.004093:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781935.004116:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004129:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004136:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004143:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004160:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781935.004164:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004172:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004186:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787781935.004189:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781935.004194:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004201:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c90454126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004217:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004223:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004228:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004233:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781935.004235:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004242:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004261:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ef45088ac00) 00010000:00010000:2.0:1787781935.004264:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781935.004267:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004273:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045412d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004306:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045411f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8b9 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004326:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8b9 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.004333:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef45088a300) 00010000:00010000:2.0:1787781935.004335:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781935.004337:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414600, rc 0) 00000100:00100000:2.0:1787781935.005876:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:9687:x1874625005896704:12345-192.168.202.56@tcp:101:chown.0 Request processed in 2646us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781935.005887:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:3.0:1787781935.010378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781935.012050:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005896960 00000100:00100000:1.0:1787781935.012064:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005896960 00000100:00100000:0.0:1787781935.012544:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:0.0:1787781935.012557:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:9687:x1874625005896960:12345-192.168.202.56@tcp:36:chown.0 00010000:00010000:0.0:1787781935.012687:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781935.012716:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8b9 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.012737:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef45088a300) 00010000:00010000:0.0:1787781935.012747:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781935.012785:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.012886:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.012895:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781935.059529:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781935.059588:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781935.059686:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005897088 00000100:00100000:1.0:1787781935.059697:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005897088 00000100:00100000:1.0:1787781935.059752:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:1.0:1787781935.059761:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2352:x1874625005897088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781935.059852:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2352:x1874625005897088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 92us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781935.059860:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:3.0:1787781935.060286:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005897216 00000100:00100000:3.0:1787781935.060291:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005897216 00000100:00100000:3.0:1787781935.060341:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 93 00000100:00100000:3.0:1787781935.060349:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2352:x1874625005897216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:0.0:1787781935.060587:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781935.060692:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2352:x1874625005897216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 342us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781935.060700:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 93 00000001:00080000:2.0:1787781935.082097:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1787781935.082437:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ffca8f7 reply state 0000000012c37fc9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781935.082451:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787781935.082771:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1787781935.083116:0:9081:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787781935.083139:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:9687:x1874625005896960:12345-192.168.202.56@tcp:36:chown.0 Request processed in 70581us (72768us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787781935.083156:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00010000:00010000:1.0:1787781935.083287:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.083296:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.083304:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.083311:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781935.083316:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.083323:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.083346:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:1.0:1787781935.083349:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787781935.083354:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.083360:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045413b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781935.113471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781935.113557:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005897344 00000100:00100000:2.0:1787781935.113565:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005897344 00000100:00100000:2.0:1787781935.113632:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1787781935.113642:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:9688:x1874625005897344:12345-192.168.202.56@tcp:101:touch.500 00010000:00010000:2.0:1787781935.113666:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781935.113684:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8c0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787781935.114881:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1141us 00010000:00010000:0.0:1787781935.131032:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131055:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131067:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131084:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131100:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131105:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131578:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454157 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131586:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131592:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781935.131685:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787781935.131689:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787781935.131770:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454157 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131781:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131785:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131818:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131825:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781935.131829:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131843:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131856:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:0.0:1787781935.131859:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781935.131864:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131870:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131882:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131887:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131892:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131898:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781935.131901:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131907:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131914:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ef44a9a7e00) 00010000:00010000:0.0:1787781935.131916:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781935.131919:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131936:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454150 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131978:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8c0 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.131994:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454157 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8c0 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.132003:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7000) 00010000:00010000:0.0:1787781935.132005:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787781935.132008:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030c00, rc 0) 00000100:00100000:0.0:1787781935.132089:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:9688:x1874625005897344:12345-192.168.202.56@tcp:101:touch.500 Request processed in 18447us (18625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781935.132098:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:1.0:1787781935.137009:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781935.137100:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005897600 00000100:00100000:2.0:1787781935.137110:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005897600 00000100:00100000:2.0:1787781935.137176:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:2.0:1787781935.137187:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:9688:x1874625005897600:12345-192.168.202.56@tcp:101:touch.500 00010000:00010000:2.0:1787781935.137210:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781935.137233:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045415e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.138247:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.138267:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.138281:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.138333:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.138342:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.138349:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787781935.142324:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787781935.143318:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.143339:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.143351:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.143389:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.143396:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.143403:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.143409:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781935.143413:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.143421:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.143433:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7000) 00010000:00010000:2.0:1787781935.143436:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781935.143441:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.143448:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454165 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781935.144113:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000995c4b74 reply state 0000000017883e8f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.144127:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787781935.144184:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045415e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8c7 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.144201:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8c7 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.144210:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef45088a400) 00010000:00010000:2.0:1787781935.144213:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781935.144215:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414a00, rc 0) 00000100:00100000:2.0:1787781935.144306:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:9688:x1874625005897600:12345-192.168.202.56@tcp:101:touch.500 Request processed in 7120us (7307us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787781935.144315:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00010000:00010000:1.0:1787781935.155376:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.155394:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.155403:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.155409:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781935.155414:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.155422:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.155461:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x27b6432d (ffff9ef45088ac00) 00010000:00010000:1.0:1787781935.155465:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781935.155470:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.155476:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c9045416c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781935.157269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781935.157481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005897856 00000100:00100000:3.0:1787781935.157493:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005897856 00000100:00100000:3.0:1787781935.157554:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:3.0:1787781935.157564:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:9688:x1874625005897856:12345-192.168.202.56@tcp:36:touch.500 00010000:00010000:3.0:1787781935.157614:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781935.157650:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8c7 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.157685:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef45088a400) 00010000:00010000:3.0:1787781935.157694:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781935.157733:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.157744:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.157753:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781935.157903:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5e38902 reply state 0000000072feade4 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781935.157912:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787781935.157992:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:9688:x1874625005897856:12345-192.168.202.56@tcp:36:touch.500 Request processed in 429us (732us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787781935.157999:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00010000:00010000:3.0:1787781935.159323:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.159336:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.159343:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.159350:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781935.159355:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.159374:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.159388:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef44a7db500) 00010000:00010000:3.0:1787781935.159391:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781935.159396:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.159402:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454181 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781935.160367:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781935.160435:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005897984 00000100:00100000:2.0:1787781935.160443:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005897984 00000100:00100000:2.0:1787781935.160500:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:2.0:1787781935.160509:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:9688:x1874625005897984:12345-192.168.202.56@tcp:101:touch.500 00010000:00010000:2.0:1787781935.160542:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781935.160562:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415800/0x3ad9816c90454188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8ce expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.160615:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415800/0x3ad9816c90454188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ce expref: 10 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.160657:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415800/0x3ad9816c90454188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ce expref: 10 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.160676:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef45088a500) 00010000:00010000:2.0:1787781935.160679:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781935.160683:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415800, rc 0) 00000100:00100000:2.0:1787781935.160740:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:9688:x1874625005897984:12345-192.168.202.56@tcp:101:touch.500 Request processed in 231us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781935.160748:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:2.0:1787781935.164719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781935.167198:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005898112 00000100:00100000:3.0:1787781935.167213:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005898112 00000100:00100000:3.0:1787781935.167424:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1787781935.167433:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874625005898112:12345-192.168.202.56@tcp:8:touch.500 00010000:00080000:3.0:1787781935.167479:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:3.0:1787781935.167511:0:6697:0:(genops.c:1385:class_connect()) connect: client 3fd2e199-5730-414f-9ae9-e4e10b451cbf, cookie 0x3ad9816c9045418f 00002000:00100000:3.0:1787781935.167533:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3fd2e199-5730-414f-9ae9-e4e10b451cbf/ffff9ef4809ae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787781935.167559:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787781935.167990:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787781935.168025:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9ef4809a8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787781935.168320:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2348:x1874625005898112:12345-192.168.202.56@tcp:8:touch.500 Request processed in 885us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781935.168330:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1787781935.171409:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781935.171597:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005898240 00000100:00100000:0.0:1787781935.171638:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005898240 00000100:00100000:0.0:1787781935.171716:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:0.0:1787781935.171728:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:0:x1874625005898240:12345-192.168.202.56@tcp:2:touch.500 00000100:00080000:2.0:1787781935.172836:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787781935.234109:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1787781935.234249:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000100:00100000:0.0:1787781935.234327:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:0:x1874625005898240:12345-192.168.202.56@tcp:2:touch.500 Request processed in 62596us (62922us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787781935.234338:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1787781935.237084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781935.237223:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005898496 00000100:00100000:1.0:1787781935.237233:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005898496 00000100:00100000:1.0:1787781935.237281:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1787781935.237292:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:9688:x1874625005898496:12345-192.168.202.56@tcp:35:touch.500 00000100:00100000:1.0:1787781935.237597:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:9688:x1874625005898496:12345-192.168.202.56@tcp:35:touch.500 Request processed in 306us (523us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787781935.237606:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1787781935.251673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781935.251762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005898624 00000100:00100000:3.0:1787781935.251773:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005898624 00000100:00100000:3.0:1787781935.251883:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:3.0:1787781935.251893:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:9689:x1874625005898624:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1787781935.251919:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781935.251940:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454196 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8d5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.252225:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c9045419d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.252241:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c9045419d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.252254:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c9045419d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781935.252312:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787781935.252315:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781935.252356:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c9045419d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.252382:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454196 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8d5 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.252398:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c9045419d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8d5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.252406:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7000) 00010000:00010000:3.0:1787781935.252410:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781935.252413:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3600, rc 0) 00000100:00100000:3.0:1787781935.252670:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:9689:x1874625005898624:12345-192.168.202.56@tcp:101:rm.0 Request processed in 777us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781935.252686:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:3.0:1787781935.260824:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781935.265163:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005898880 00000100:00100000:1.0:1787781935.265176:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005898880 00000100:00100000:1.0:1787781935.265245:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:1.0:1787781935.265255:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:9689:x1874625005898880:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:1.0:1787781935.265276:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781935.265298:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904541a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8dc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781935.265409:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787781935.265596:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904541a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8dc expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.265612:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:1.0:1787781935.265615:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781935.265634:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904541a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8dc expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.265648:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183fa00, rc 0) 00000100:00100000:1.0:1787781935.265711:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:9689:x1874625005898880:12345-192.168.202.56@tcp:101:rm.0 Request processed in 458us (4935us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787781935.265719:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:1.0:1787781935.270031:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781935.270215:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005899008 00000100:00100000:0.0:1787781935.270226:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005899008 00000100:00100000:0.0:1787781935.270290:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:0.0:1787781935.270300:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:9689:x1874625005899008:12345-192.168.202.56@tcp:37:rm.0 00000100:00100000:3.0:1787781935.275929:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:9689:x1874625005899008:12345-192.168.202.56@tcp:37:rm.0 Request processed in 5620us (5898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781935.275943:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1787781935.284288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781935.284485:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005899264 00000100:00100000:1.0:1787781935.284495:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005899264 00000100:00100000:1.0:1787781935.284557:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:1.0:1787781935.284567:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff2c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:9689:x1874625005899264:12345-192.168.202.56@tcp:35:rm.0 00000100:00100000:1.0:1787781935.284874:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff2c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:9689:x1874625005899264:12345-192.168.202.56@tcp:35:rm.0 Request processed in 307us (596us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787781935.284883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:1.0:1787781935.289898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781935.290193:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005899520 00000100:00100000:2.0:1787781935.290204:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005899520 00000100:00100000:2.0:1787781935.290269:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1787781935.290280:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:9689:x1874625005899520:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1787781935.290307:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781935.290330:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415e00/0x3ad9816c904541b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8e3 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.290542:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904541b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.290558:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904541b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.290598:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904541b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781935.290610:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787781935.290823:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415e00/0x3ad9816c904541b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8e3 expref: 17 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.290843:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904541b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8e3 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.290852:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7000) 00010000:00010000:2.0:1787781935.290855:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787781935.291613:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415200, rc 0) 00000100:00100000:2.0:1787781935.291738:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:9689:x1874625005899520:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1459us (1848us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787781935.291746:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:0.0:1787781935.304870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781935.304995:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005899648 00000100:00100000:1.0:1787781935.305006:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005899648 00000100:00100000:1.0:1787781935.305065:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:1.0:1787781935.305075:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:9689:x1874625005899648:12345-192.168.202.56@tcp:41:rm.0 00000004:00000024:1.0:1787781935.305135:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787781935.305304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:9689:x1874625005899648:12345-192.168.202.56@tcp:41:rm.0 Request processed in 230us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781935.305313:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:2.0:1787781935.308520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781935.308668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005899776 00000100:00100000:3.0:1787781935.308677:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005899776 00000100:00100000:3.0:1787781935.308770:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:3.0:1787781935.308780:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:9689:x1874625005899776:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1787781935.308838:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781935.308860:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c904541c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8ea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.308920:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.308934:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.308945:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.308958:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.308965:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.308989:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309099:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c904541dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309107:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c904541dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309114:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c904541dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781935.309141:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787781935.309145:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781935.309163:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c904541dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309174:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c904541dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309182:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309189:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309197:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309203:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781935.309207:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309221:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309234:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7000) 00010000:00010000:3.0:1787781935.309238:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781935.309242:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309248:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904541ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309263:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309269:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309276:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309281:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781935.309284:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309291:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309298:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x27b6432d (ffff9ef44a7db500) 00010000:00010000:3.0:1787781935.309301:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781935.309303:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309320:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3200/0x3ad9816c904541d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309346:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c904541c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ea expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309358:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c904541dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ea expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.309366:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef45088a500) 00010000:00010000:3.0:1787781935.309368:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781935.309370:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2a00, rc 0) 00000100:00100000:3.0:1787781935.309421:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:9689:x1874625005899776:12345-192.168.202.56@tcp:101:rm.0 Request processed in 643us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781935.309427:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:2.0:1787781935.321572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781935.321685:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005900032 00000100:00100000:0.0:1787781935.321697:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005900032 00000100:00100000:0.0:1787781935.321777:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:0.0:1787781935.321839:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:9689:x1874625005900032:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:0.0:1787781935.321910:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787781935.321943:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c904541dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ea expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.321966:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415800/0x3ad9816c90454188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ce expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.321978:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef45088a500) 00010000:00010000:0.0:1787781935.321994:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c9045419d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8d5 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.322001:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7000) 00010000:00010000:0.0:1787781935.322004:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781935.322024:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.322036:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.322045:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.322057:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.322073:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.322091:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.322212:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.322220:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.322227:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781935.322983:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787781935.322994:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303101204971ns, next at 304101202658ns, rc = 0 00010000:00010000:0.0:1787781935.323052:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323061:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323069:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323077:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323082:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323097:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323111:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787781935.323132:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323138:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323143:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323148:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781935.323152:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323158:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323167:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef44a9a7e00) 00010000:00010000:0.0:1787781935.323169:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787781935.323173:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323179:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904541f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323194:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323200:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323214:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323218:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781935.323221:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323227:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323234:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7000) 00010000:00010000:0.0:1787781935.323237:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781935.323240:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.323245:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781935.323254:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055b93100 reply state 00000000c57d474d transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781935.323261:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781935.323346:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:9689:x1874625005900032:12345-192.168.202.56@tcp:36:rm.0 Request processed in 1509us (2159us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787781935.323355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00010000:00010000:3.0:1787781935.325102:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781935.325113:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.325122:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781935.325126:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.325136:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.325152:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ef44a9a7e00) 00010000:00010000:3.0:1787781935.325155:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787781935.325170:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.325178:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904541f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.325201:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781935.325203:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781935.325205:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781935.333824:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781935.333893:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005900288 00000100:00100000:2.0:1787781935.333904:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005900288 00000100:00100000:2.0:1787781935.334008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1787781935.334018:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:9689:x1874625005900288:12345-192.168.202.56@tcp:35:rm.0 00000100:00100000:2.0:1787781935.334268:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:9689:x1874625005900288:12345-192.168.202.56@tcp:35:rm.0 Request processed in 251us (490us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787781935.334276:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00010000:00010000:1.0:1787781935.336272:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.336309:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.336316:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.336322:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781935.336326:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.336334:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.336350:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x27b6432d (ffff9ef44a9a7900) 00010000:00010000:1.0:1787781935.336353:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781935.336357:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781935.336363:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904541ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.340972:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781935.341115:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005900544 00000100:00100000:0.0:1787781935.341125:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005900544 00000100:00100000:0.0:1787781935.341174:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:0.0:1787781935.341184:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:9689:x1874625005900544:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:0.0:1787781935.341252:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787781935.341280:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904541b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8e3 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341300:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454157 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8c0 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341310:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7000) 00010000:00010000:0.0:1787781935.341324:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454118 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8b2 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341332:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:0.0:1787781935.341338:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781935.341359:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341373:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341384:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341441:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341449:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341456:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341860:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341873:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.341880:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781935.343329:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787781935.343351:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343361:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343369:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343376:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781935.343381:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343389:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343403:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ef44a9a7800) 00010000:00010000:2.0:1787781935.343407:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787781935.343411:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343417:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031000/0x3ad9816c9045420d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343440:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343445:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343452:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343468:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781935.343472:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343478:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343487:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a9a7600) 00010000:00010000:2.0:1787781935.343490:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781935.343493:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781935.343499:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904541ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781935.343513:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c44d5586 reply state 00000000c2740c38 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781935.343522:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781935.343613:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:9689:x1874625005900544:12345-192.168.202.56@tcp:36:rm.0 Request processed in 2426us (2657us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787781935.343632:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00010000:00010000:3.0:1787781935.349431:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.349450:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.349459:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.349478:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781935.349483:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.349504:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.349524:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ef44a9a7200) 00010000:00010000:3.0:1787781935.349527:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781935.349533:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781935.349541:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454206 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781935.358609:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781936.318336:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a717840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023756800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781936.318413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781936.318539:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023756800 00000100:00100000:3.0:1787781936.318547:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023756800 00000100:00100000:3.0:1787781936.318629:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787781936.318639:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023756800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781936.318675:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781936.318734:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023756800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781936.318741:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787781936.318905:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787781936.318935:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44a717840 x1874625023756800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781936.318954:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a717840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023756800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781936.319207:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023757056:0@lo:400:kworker.0 00000100:00100000:2.0:1787781936.319243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781936.319262:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781936.319268:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023757184:0@lo:400:kworker.0 00000100:00100000:2.0:1787781936.319289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781936.319316:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023757056 00000100:00100000:2.0:1787781936.319333:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023757056 00000100:00100000:2.0:1787781936.319362:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023757184 00000100:00100000:2.0:1787781936.319365:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023757184 00000100:00100000:2.0:1787781936.319390:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787781936.319396:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023757056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781936.319436:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023757056:12345-0@lo:400:kworker.0 Request processed in 40us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781936.319443:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787781936.319455:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787781936.319462:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023757184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781936.319489:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023757184:12345-0@lo:400:kworker.0 Request processed in 28us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781936.319494:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787781936.319509:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781936.319528:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023757184:0@lo:400:kworker.0 00000100:00100000:2.0:1787781936.319537:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023757056:0@lo:400:kworker.0 00000100:00100000:0.0:1787781936.319692:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023757312:0@lo:400:kworker.0 00000100:00100000:0.0:1787781936.319725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781936.319754:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787781936.319760:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023756928:0@lo:400:kworker.0 00000100:00100000:0.0:1787781936.319784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781936.319830:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023757440:0@lo:400:kworker.0 00000100:00100000:0.0:1787781936.319849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781936.319873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023756928 00000100:00100000:0.0:1787781936.319876:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023756928 00000100:00100000:0.0:1787781936.319899:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787781936.319912:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023756928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781936.319946:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023756928:12345-0@lo:400:kworker.0 Request processed in 35us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781936.319952:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787781936.319985:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023756928:0@lo:400:kworker.0 00000100:00100000:0.0:1787781936.319999:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023757440 00000100:00100000:0.0:1787781936.320002:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023757440 00000100:00100000:0.0:1787781936.320029:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787781936.320035:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476778780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023757440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781936.320065:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476778780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023757440:12345-0@lo:400:kworker.0 Request processed in 31us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781936.320072:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787781936.320084:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781936.320102:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023757440:0@lo:400:kworker.0 00000100:00100000:2.0:1787781936.320307:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023757312 00000100:00100000:2.0:1787781936.320311:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023757312 00000100:00100000:2.0:1787781936.320357:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787781936.320364:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023757312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781936.320400:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023757312:12345-0@lo:400:kworker.0 Request processed in 37us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781936.320406:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787781936.320660:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787781936.320695:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef476f09a40 x1874625023757312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781936.320704:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023757312:0@lo:400:kworker.0 00010000:00010000:1.0:1787781936.382130:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781936.857932:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787781936.857955:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023757568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781936.858022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781936.858096:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023757568 00000100:00100000:1.0:1787781936.858104:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023757568 00000100:00100000:1.0:1787781936.858149:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787781936.858158:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023757568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781936.858234:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781936.858280:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023757568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781936.858287:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787781936.858334:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478dbd2c0 x1874625023757568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781936.858352:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023757568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781937.413243:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781938.436014:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781939.453980:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781940.164396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781940.164441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781940.164472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781940.164524:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781940.164561:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005900800 00000100:00100000:2.0:1787781940.164569:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005900800 00000100:00100000:3.0:1787781940.164620:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005901056 00000100:00100000:3.0:1787781940.164633:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005901056 00000100:00100000:2.0:1787781940.164656:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:2.0:1787781940.164669:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:2351:x1874625005900800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781940.164712:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00100000:3.0:1787781940.164727:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005901056:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781940.164758:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:2351:x1874625005900800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781940.164768:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:3.0:1787781940.164836:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005901056:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781940.164843:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00080000:2.0:1787781940.164844:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781940.165047:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005900928 00000100:00100000:1.0:1787781940.165053:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005900928 00000100:00100000:1.0:1787781940.165112:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:1.0:1787781940.165128:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005900928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781940.165180:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005900928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781940.165188:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:0.0:1787781940.165283:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005900672 00000100:00100000:0.0:1787781940.165289:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005900672 00000100:00100000:0.0:1787781940.165327:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00100000:0.0:1787781940.165335:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005900672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781940.165380:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005900672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 46us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781940.165387:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00080000:2.0:1787781940.165506:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1787781940.385831:0:11626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787781940.479058:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787781940.494099:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1787781940.494112:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787781940.494146:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1787781940.494319:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781940.494341:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476779680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023757696:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787781940.494411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781940.494562:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023757696 00000100:00100000:2.0:1787781940.494569:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023757696 00000100:00100000:2.0:1787781940.494642:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787781940.494651:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4767783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023757696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787781940.494679:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787781940.494715:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f6330, atime: 0x6a8f6330, ctime: 0x6a8f6330, blocks: 0x1 00010000:00010000:2.0:1787781940.494727:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.494743:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:2.0:1787781940.494748:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781940.494753:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.494772:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.494819:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.494828:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.494847:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787781940.495375:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4767783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625023757696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 722us (961us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787781940.495384:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787781940.495409:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787781940.495428:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.495437:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787781940.495441:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.495449:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.495467:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.495474:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454214 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781940.495502:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781940.495504:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781940.495506:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787781940.495538:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef476779680/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787781940.495545:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476779680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023757696:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1787781940.495812:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787781941.439603:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781941.439676:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023757824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781941.439746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781941.439830:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023757824 00000100:00100000:3.0:1787781941.439837:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023757824 00000100:00100000:3.0:1787781941.439883:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787781941.439892:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023757824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781941.439928:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781941.439971:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023757824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781941.439988:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787781941.440036:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023757824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781941.442197:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023758336:0@lo:400:kworker.0 00000100:00100000:0.0:1787781941.442261:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781941.442302:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787781941.442308:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023757952:0@lo:400:kworker.0 00000100:00100000:0.0:1787781941.442336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781941.442371:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023758464:0@lo:400:kworker.0 00000100:00100000:0.0:1787781941.442393:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781941.442625:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023758336 00000100:00100000:3.0:1787781941.442633:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023758336 00000100:00100000:3.0:1787781941.442696:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787781941.442705:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023758336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781941.442761:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023758336:12345-0@lo:400:kworker.0 Request processed in 57us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781941.442768:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787781941.442834:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478a57840 x1874625023758336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781941.442846:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023758336:0@lo:400:kworker.0 00000100:00080000:0.0:1787781941.442910:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781941.443544:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023758080:0@lo:400:kworker.0 00000100:00100000:2.0:1787781941.443600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781941.443639:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787781941.443646:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023758208:0@lo:400:kworker.0 00000100:00100000:2.0:1787781941.443668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781941.443710:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023758464 00000100:00100000:2.0:1787781941.443714:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023758464 00000100:00100000:2.0:1787781941.443753:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023758080 00000100:00100000:2.0:1787781941.443756:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023758080 00000100:00100000:2.0:1787781941.443768:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023758208 00000100:00100000:2.0:1787781941.443770:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023758208 00000100:00100000:2.0:1787781941.443785:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787781941.443813:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476778f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023758464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781941.443855:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476778f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023758464:12345-0@lo:400:kworker.0 Request processed in 44us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781941.443861:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787781941.443875:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787781941.443881:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023758080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781941.443913:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023758080:12345-0@lo:400:kworker.0 Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781941.443935:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787781941.443948:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787781941.443954:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023758208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781941.443983:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023758208:12345-0@lo:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781941.443989:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1787781941.444005:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781941.444028:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023758208:0@lo:400:kworker.0 00000100:00100000:2.0:1787781941.444037:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023758080:0@lo:400:kworker.0 00000100:00100000:2.0:1787781941.444071:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023758464:0@lo:400:kworker.0 00000100:00100000:0.0:1787781941.444853:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023757952 00000100:00100000:0.0:1787781941.444860:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023757952 00000100:00100000:0.0:1787781941.444899:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787781941.444906:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023757952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781941.444957:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023757952:12345-0@lo:400:kworker.0 Request processed in 52us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781941.444963:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787781941.445042:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023757952:0@lo:400:kworker.0 00000020:00000080:1.0:1787781941.459937:0:11676:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd3bb5070 20000000:00000080:1.0:1787781941.459953:0:11676:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef47f49f400 uarg=0000000000000000 20000000:01000000:1.0:1787781941.459999:0:11676:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787781941.460005:0:11676:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787781941.460011:0:11676:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787781941.464981:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787781941.467763:0:11676:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787781941.476371:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787781941.476497:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787781941.476639:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787781941.476660:0:11676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787781941.476678:0:11676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.476699:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d89d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.476707:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8a4 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.476715:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904540c4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.476733:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904540d2 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.476739:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904540e0 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.476746:0:11676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.476783:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c904540e0 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.476829:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c904540e0 expref: 18 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781941.476842:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f0a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023758592:0@lo:104: 00000100:00100000:2.0:1787781941.476905:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781941.476958:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c904540d2 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.476966:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c904540d2 expref: 18 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781941.476974:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f08b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023758720:0@lo:104: 00000100:00100000:2.0:1787781941.476996:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781941.477021:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c904540c4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.477030:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c904540c4 expref: 18 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781941.477045:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f09e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023758848:0@lo:104: 00000100:00100000:2.0:1787781941.477069:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787781941.477102:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8a4 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.477112:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8a4 expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781941.477121:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b41e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023758976:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781941.477675:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787781941.477690:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023758592 00000100:00100000:1.0:1787781941.477697:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023758592 00000100:00100000:1.0:1787781941.477741:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023758720 00000100:00100000:1.0:1787781941.477745:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023758720 00000100:00100000:1.0:1787781941.477754:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023758848 00000100:00100000:1.0:1787781941.477757:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023758848 00000100:00100000:1.0:1787781941.477769:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781941.477776:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:11676:x1874625023758592:12345-0@lo:104: 00010000:00010000:1.0:1787781941.477804:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.477857:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787781941.477863:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+5:11676:x1874625023758592:12345-0@lo:104: Request processed in 87us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.477870:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787781941.477887:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787781941.477893:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:11676:x1874625023758720:12345-0@lo:104: 00010000:00010000:1.0:1787781941.477901:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.477936:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787781941.477941:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+4:11676:x1874625023758720:12345-0@lo:104: Request processed in 50us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.477947:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787781941.477959:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787781941.477965:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47b2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:11676:x1874625023758848:12345-0@lo:104: 00010000:00010000:1.0:1787781941.477973:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478003:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787781941.478013:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47b2bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+3:11676:x1874625023758848:12345-0@lo:104: Request processed in 48us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.478020:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787781941.478058:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787781941.478064:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478072:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441480a00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787781941.478076:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478099:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781941.478547:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781941.478554:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787781941.478604:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478611:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781941.478632:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478639:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef441480a00/0x3ad9816c904540e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904540e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478652:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787781941.478656:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478673:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2800 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787781941.478677:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478683:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781941.478690:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781941.478695:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787781941.478709:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478716:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781941.478721:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478727:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2800/0x3ad9816c904540d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904540d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478735:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781941.478738:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478744:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031800 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787781941.478747:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478764:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787781941.478772:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787781941.478777:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787781941.478825:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478832:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787781941.478848:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478855:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef440031800/0x3ad9816c904540c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904540cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.478868:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781941.478870:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781941.478872:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781941.478878:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781941.478883:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781941.478897:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023759104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781941.478937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781941.478974:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781941.478979:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023759232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781941.479000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781941.479028:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023759360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781941.479061:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781941.482650:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023759104 00000100:00100000:1.0:1787781941.482677:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023759104 00010000:00010000:1.0:1787781941.482734:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904540e0 expref: 19 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781941.482780:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023759232 00000100:00100000:1.0:1787781941.482784:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023759232 00010000:00010000:1.0:1787781941.482810:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904540d2 expref: 20 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781941.482821:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023759360 00000100:00100000:1.0:1787781941.482823:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023759360 00010000:00010000:1.0:1787781941.482833:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904540c4 expref: 21 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781941.482844:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787781941.482852:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+21:3305:x1874625023759104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787781941.482865:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781941.482870:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904540e0 expref: 21 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.482882:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c904540e0 expref: 21 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.482902:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781941.482973:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+21:3305:x1874625023759104:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (4034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.482980:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787781941.482997:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787781941.483017:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+20:3305:x1874625023759232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787781941.483025:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781941.483029:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904540d2 expref: 20 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.483036:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c904540d2 expref: 20 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.483046:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781941.483068:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+20:3305:x1874625023759232:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (4068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.483074:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787781941.483085:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787781941.483091:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450caac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023759360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787781941.483098:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781941.483101:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904540c4 expref: 19 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.483110:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c904540c4 expref: 19 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.483119:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781941.483146:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450caac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023759360:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (4083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.483152:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787781941.483237:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023759360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781941.483269:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023759232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787781941.483277:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023759104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787781941.483442:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d89d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.483455:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d89d expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781941.483467:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023759488:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781941.483530:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4465d4240 going to sleep for 11 seconds 00010000:00010000:2.0:1787781941.483546:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef441481e00/0x3ad9816c904540e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c904540e0 expref: 18 pid: 5827 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781941.483558:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f0a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023758592:0@lo:104: 00010000:00010000:2.0:1787781941.483586:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef441480c00/0x3ad9816c904540d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c904540d2 expref: 17 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781941.483594:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f08b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023758720:0@lo:104: 00010000:00010000:2.0:1787781941.483604:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef450ba2200/0x3ad9816c904540cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c904540c4 expref: 16 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781941.483624:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f09e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023758848:0@lo:104: 00000100:00100000:3.0:1787781941.501656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781941.501782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781941.502003:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b41e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023758976:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781941.502015:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625023759488:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781941.502050:0:11676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.502287:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781941.502478:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005901184 00000100:00100000:1.0:1787781941.502485:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005901184 00010000:00010000:1.0:1787781941.502522:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8a4 expref: 13 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781941.502555:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005901312 00000100:00100000:1.0:1787781941.502558:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005901312 00010000:00010000:1.0:1787781941.502582:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d89d expref: 14 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781941.502609:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:1.0:1787781941.502617:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+14:2351:x1874625005901184:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781941.502632:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781941.502637:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8a4 expref: 14 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502649:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8a4 expref: 14 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502667:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef450ba3c00/0x3ad9816c904540bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8a4 expref: 14 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502680:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781941.502725:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005901184:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 108us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.502733:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:1.0:1787781941.502748:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:1.0:1787781941.502753:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:2351:x1874625005901312:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781941.502774:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781941.502779:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d89d expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502811:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d89d expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502822:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef450ba2000/0x3ad9816c904540b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d89d expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502833:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502841:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502855:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502862:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502869:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502876:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502882:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787781941.502886:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502903:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502915:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781941.502923:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781941.502940:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:2351:x1874625005901312:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 186us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.502946:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00010000:00010000:2.0:1787781941.503818:0:11676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.503831:0:11676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781941.503836:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef451415000/0x3ad9816c9045421b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781941.950696:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787781941.950722:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023759616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781941.950833:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781941.950973:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023759616 00000100:00100000:1.0:1787781941.950980:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023759616 00000100:00100000:1.0:1787781941.951031:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787781941.951039:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023759616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787781941.951074:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781941.951135:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023759616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781941.951141:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787781941.951302:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478dbed00 x1874625023759616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781941.951321:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023759616:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787781942.526317:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781943.427987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781943.428085:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005901440 00000100:00100000:0.0:1787781943.428095:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005901440 00000100:00100000:0.0:1787781943.428154:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 251 00000100:00100000:0.0:1787781943.428163:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:5590:x1874625005901440:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787781943.428194:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781943.428212:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440031000/0x3ad9816c90454222 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8f1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781943.428240:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440031000/0x3ad9816c90454222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8f1 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781943.428252:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440031000/0x3ad9816c90454222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8f1 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781943.428261:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031000, rc 0) 00000100:00100000:0.0:1787781943.428323:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005901440:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 160us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781943.428330:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 251 00000100:00100000:1.0:1787781943.433011:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781943.433896:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005901568 00000100:00100000:2.0:1787781943.433908:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005901568 00000100:00100000:2.0:1787781943.433973:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 252 00000100:00100000:2.0:1787781943.433983:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005901568:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.434283:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005901568:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 300us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.434291:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 252 00000100:00100000:3.0:1787781943.438959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781943.439085:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005901696 00000100:00100000:1.0:1787781943.439101:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005901696 00000100:00100000:1.0:1787781943.439178:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:1.0:1787781943.439188:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005901696:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781943.439428:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005901696:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 240us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781943.439446:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:1.0:1787781943.447897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781943.452151:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005901824 00000100:00100000:0.0:1787781943.452167:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005901824 00000100:00100000:0.0:1787781943.452244:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:0.0:1787781943.452255:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:9960:x1874625005901824:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787781943.452581:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:9960:x1874625005901824:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 327us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781943.452590:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:3.0:1787781943.457128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781943.457233:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005901952 00000100:00100000:2.0:1787781943.457243:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005901952 00000100:00100000:2.0:1787781943.457310:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:2.0:1787781943.457320:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:9960:x1874625005901952:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787781943.457602:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:9960:x1874625005901952:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 281us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.457609:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:3.0:1787781943.480232:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781943.481396:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005902080 00000100:00100000:1.0:1787781943.481413:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005902080 00000100:00100000:1.0:1787781943.481503:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00100000:1.0:1787781943.481514:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:5590:x1874625005902080:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781943.481614:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781943.481634:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef48183f600/0x3ad9816c90454229 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8f8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781943.481666:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183f600/0x3ad9816c90454229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8f8 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781943.481678:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef48183f600/0x3ad9816c90454229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8f8 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781943.481686:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f600, rc 0) 00000100:00100000:1.0:1787781943.481765:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005902080:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 253us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781943.481772:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00100000:1.0:1787781943.486878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781943.487009:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005902208 00000100:00100000:0.0:1787781943.487019:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005902208 00000100:00100000:0.0:1787781943.487075:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 257 00000100:00100000:0.0:1787781943.487085:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005902208:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787781943.487381:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005902208:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 296us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781943.487396:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 257 10000000:01000000:1.0:1787781943.487629:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787781943.487633:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef444b97000 from 7 10000000:01000000:1.0:1787781943.487636:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787781943.487673:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781943.487684:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781943.487699:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781943.487720:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023759744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787781943.487760:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781943.487829:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.487882:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023759744 00000100:00100000:2.0:1787781943.487888:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023759744 00000100:00100000:2.0:1787781943.487919:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787781943.487927:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:5830:x1874625023759744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781943.487936:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781943.487947:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef451415800/0x3ad9816c90454237 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90454230 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.487967:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef451415800/0x3ad9816c90454237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90454230 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.487978:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef451415800/0x3ad9816c90454237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90454230 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.487988:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415800, rc 0) 00000100:00100000:2.0:1787781943.488025:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023759744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.488031:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787781943.489518:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023759744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781943.489561:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781943.489572:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781943.489644:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023759872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781943.489695:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781943.489740:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.489896:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023759872 00000100:00100000:2.0:1787781943.489902:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023759872 00000100:00100000:2.0:1787781943.489949:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787781943.489958:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023759872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.490242:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023759872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.490250:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787781943.490492:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023759872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781943.490675:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023760000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781943.490720:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781943.490753:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.490809:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023760000 00000100:00100000:2.0:1787781943.490814:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023760000 00000100:00100000:2.0:1787781943.490842:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787781943.490850:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023760000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.491014:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023760000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.491021:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787781943.491286:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023760000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781943.493911:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11689:1874625023760128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781943.493997:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781943.494048:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a190c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.494200:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023760128 00000100:00100000:2.0:1787781943.494207:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023760128 00000100:00100000:2.0:1787781943.494258:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787781943.494268:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:11689:x1874625023760128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781943.494512:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:11689:x1874625023760128:12345-0@lo:502:llog_process_th.0 Request processed in 244us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.494520:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787781943.494880:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11689:1874625023760128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787781943.494918:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787781943.494928:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787781943.494931:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787781943.494937:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef444b97000 00000020:00000080:1.0:1787781943.494939:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787781943.495033:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11689:1874625023760256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781943.495071:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781943.495093:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a190c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.498688:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023760256 00000100:00100000:2.0:1787781943.498701:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023760256 00000100:00100000:2.0:1787781943.498756:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787781943.498765:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:11689:x1874625023760256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781943.499056:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:11689:x1874625023760256:12345-0@lo:502:llog_process_th.0 Request processed in 291us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.499063:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787781943.499213:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11689:1874625023760256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781943.499256:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781943.499262:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781943.499265:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787781943.499269:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787781943.499393:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787781943.499409:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787781943.499418:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.499429:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787781943.499439:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787781943.499442:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef450a67000 from 7 10000000:01000000:2.0:1787781943.499444:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787781943.499471:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.499480:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.499488:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781943.499507:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023760384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.500034:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781943.500067:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478db8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.500083:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023760384 00000100:00100000:2.0:1787781943.500088:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023760384 00000100:00100000:2.0:1787781943.500126:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787781943.500142:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:5830:x1874625023760384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781943.500154:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781943.500166:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef451414800/0x3ad9816c90454245 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c9045423e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.500190:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef451414800/0x3ad9816c90454245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c9045423e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.500200:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef451414800/0x3ad9816c90454245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c9045423e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.500208:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414800, rc 0) 00000100:00100000:2.0:1787781943.500241:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023760384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.500247:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787781943.500282:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023760384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787781943.500295:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781943.500303:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781943.500351:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023760512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.500376:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781943.500389:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478db8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.500401:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023760512 00000100:00100000:2.0:1787781943.500404:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023760512 00000100:00100000:2.0:1787781943.500426:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787781943.500439:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023760512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.504956:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023760512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4508us (4569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.504969:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787781943.505034:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023760512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.505082:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023760640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.505128:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781943.505157:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478db8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.505173:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023760640 00000100:00100000:2.0:1787781943.505178:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023760640 00000100:00100000:2.0:1787781943.505211:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787781943.505219:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023760640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.505377:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023760640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.505384:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787781943.505431:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023760640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787781943.512963:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11692:1874625023760768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781943.513059:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781943.513098:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478db8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787781943.513152:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023760768 00000100:00100000:3.0:1787781943.513160:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023760768 00000100:00100000:3.0:1787781943.513218:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787781943.513227:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:11692:x1874625023760768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781943.513442:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:11692:x1874625023760768:12345-0@lo:502:llog_process_th.0 Request processed in 215us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781943.513462:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787781943.514012:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11692:1874625023760768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781943.514040:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781943.514049:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781943.514052:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787781943.514058:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef450a67000 00000020:00000080:2.0:1787781943.514066:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787781943.514157:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11692:1874625023760896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781943.514197:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781943.514224:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023760896 00000100:00100000:2.0:1787781943.514228:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023760896 00000100:00100000:2.0:1787781943.514254:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787781943.514264:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:11692:x1874625023760896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781943.514398:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:11692:x1874625023760896:12345-0@lo:502:llog_process_th.0 Request processed in 136us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.514405:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787781943.514439:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478db8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.514464:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11692:1874625023760896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781943.514673:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781943.514678:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781943.514679:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787781943.514683:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:1.0:1787781943.514907:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781943.514930:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005902336 00000100:00100000:1.0:1787781943.514935:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005902336 00000100:00100000:1.0:1787781943.514960:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 268 00000100:00100000:1.0:1787781943.514967:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005902336:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781943.515087:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:5590:x1874625005902336:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 119us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781943.515095:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 268 00000020:01000000:3.0:1787781943.515331:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787781943.515353:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787781943.515363:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781943.515374:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787781943.515384:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787781943.515387:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef4450df800 from 7 10000000:01000000:3.0:1787781943.515389:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787781943.515415:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781943.515423:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781943.515431:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781943.515458:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023761024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787781943.515499:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781943.515726:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023761024 00000100:00100000:1.0:1787781943.515730:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023761024 00000100:00100000:1.0:1787781943.515756:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787781943.515762:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:5830:x1874625023761024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787781943.515771:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781943.515783:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90454253 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c9045424c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781943.515838:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90454253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c9045424c expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781943.515848:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90454253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c9045424c expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781943.515865:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183fc00, rc 0) 00000100:00100000:1.0:1787781943.515894:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023761024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781943.515900:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787781943.516197:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18180 going to sleep for 11 seconds 00000100:00100000:3.0:1787781943.516218:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023761024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787781943.516246:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781943.516255:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781943.516307:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023761152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781943.516337:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781943.516358:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18180 going to sleep for 11 seconds 00000100:00100000:3.0:1787781943.516373:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023761152 00000100:00100000:3.0:1787781943.516377:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023761152 00000100:00100000:3.0:1787781943.516399:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787781943.516405:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023761152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787781943.518963:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023761152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2550us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781943.518974:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787781943.522965:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781943.523166:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005902464 00000100:00100000:1.0:1787781943.523176:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005902464 00000100:00100000:1.0:1787781943.523227:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:1.0:1787781943.523237:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:9963:x1874625005902464:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787781943.523504:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:9963:x1874625005902464:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 267us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781943.523513:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:1.0:1787781943.523594:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023761152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787781943.523654:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023761280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787781943.523707:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781943.523735:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f5bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781943.525131:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023761280 00000100:00100000:3.0:1787781943.525141:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023761280 00000100:00100000:3.0:1787781943.525185:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787781943.525194:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023761280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781943.525406:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:5830:x1874625023761280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781943.525414:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787781943.525945:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9f3bcc54-cf30-454f-ba67-121e6963b1be:5830:1874625023761280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787781943.526274:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11693:1874625023761408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787781943.526330:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781943.526374:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18540 going to sleep for 11 seconds 00000100:00100000:1.0:1787781943.526920:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023761408 00000100:00100000:1.0:1787781943.526927:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023761408 00000100:00100000:1.0:1787781943.526968:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787781943.526976:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:11693:x1874625023761408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787781943.527216:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:11693:x1874625023761408:12345-0@lo:502:llog_process_th.0 Request processed in 239us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781943.527224:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787781943.529347:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11693:1874625023761408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781943.529616:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787781943.529627:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781943.529630:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787781943.529638:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef4450df800 00000020:00000080:2.0:1787781943.529641:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787781943.529736:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11693:1874625023761536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781943.529831:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781943.529871:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023761536 00000100:00100000:2.0:1787781943.529877:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023761536 00000100:00100000:2.0:1787781943.529922:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787781943.529937:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:11693:x1874625023761536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787781943.530157:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:11693:x1874625023761536:12345-0@lo:502:llog_process_th.0 Request processed in 220us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781943.530165:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787781943.530216:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478db8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787781943.530232:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9f3bcc54-cf30-454f-ba67-121e6963b1be:11693:1874625023761536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787781943.530253:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787781943.530258:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787781943.530260:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787781943.530263:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787781943.530470:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787781943.530490:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787781943.530500:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781943.530511:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787781943.532609:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787781943.544820:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781943.545518:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005902592 00000100:00100000:3.0:1787781943.545658:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005902592 00000100:00100000:3.0:1787781943.545716:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00100000:3.0:1787781943.545727:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:9963:x1874625005902592:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787781943.546913:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:9963:x1874625005902592:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 1182us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781943.546925:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 275 00010000:00010000:3.0:1787781943.550885:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781944.574047:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781944.575359:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787781945.287662:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781945.287804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781945.296067:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781945.296101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781945.296164:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005902976 00000100:00100000:1.0:1787781945.296174:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005902976 00000100:00100000:1.0:1787781945.296241:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:1.0:1787781945.296252:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005902976:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781945.296324:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005902976:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781945.296332:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00080000:1.0:1787781945.296355:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781945.296822:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005902720 00000100:00100000:0.0:1787781945.296828:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005902720 00000100:00100000:0.0:1787781945.296871:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:0.0:1787781945.296879:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2352:x1874625005902720:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781945.296917:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2352:x1874625005902720:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 41us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781945.296924:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:2.0:1787781945.299900:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005902848 00000100:00100000:2.0:1787781945.299914:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005902848 00000100:00100000:2.0:1787781945.299991:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005903104 00000100:00100000:2.0:1787781945.299994:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005903104 00000100:00100000:2.0:1787781945.300026:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 102 00000100:00100000:2.0:1787781945.300035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005902848:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781945.300110:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005902848:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 75us (12459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781945.300118:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 102 00000100:00100000:0.0:1787781945.302831:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00100000:0.0:1787781945.302857:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2352:x1874625005903104:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781945.302938:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2352:x1874625005903104:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 93us (15148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781945.302947:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00080000:1.0:1787781945.303015:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787781945.600274:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787781945.643957:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1787781946.558433:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023761664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781946.558529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781946.558625:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023762048:0@lo:400:kworker.0 00000100:00100000:2.0:1787781946.558661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781946.558718:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781946.558726:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023761920:0@lo:400:kworker.0 00000100:00100000:1.0:1787781946.558733:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023762176:0@lo:400:kworker.0 00000100:00100000:2.0:1787781946.558755:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781946.558774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781946.558834:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787781946.558842:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023761792:0@lo:400:kworker.0 00000100:00100000:2.0:1787781946.558845:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023762048 00000100:00100000:2.0:1787781946.558853:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023762048 00000100:00100000:1.0:1787781946.558886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781946.558907:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023761920 00000100:00100000:2.0:1787781946.558911:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023761920 00000100:00100000:1.0:1787781946.558916:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023762304:0@lo:400:kworker.0 00000100:00100000:2.0:1787781946.558937:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787781946.558944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781946.558948:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023762048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781946.558968:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023762304 00000100:00100000:1.0:1787781946.558973:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023762304 00000100:00100000:1.0:1787781946.559004:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787781946.559009:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023762048:12345-0@lo:400:kworker.0 Request processed in 63us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781946.559015:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023761920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781946.559021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787781946.559044:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787781946.559053:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023762304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781946.559066:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023761920:12345-0@lo:400:kworker.0 Request processed in 53us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781946.559074:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1787781946.559097:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781946.559099:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023762304:12345-0@lo:400:kworker.0 Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781946.559108:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787781946.559131:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b41680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023762304:0@lo:400:kworker.0 00000100:00100000:2.0:1787781946.559145:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023761920:0@lo:400:kworker.0 00000100:00100000:2.0:1787781946.559160:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023762048:0@lo:400:kworker.0 00000100:00100000:3.0:1787781946.559291:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023761664 00000100:00100000:3.0:1787781946.559296:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023761664 00000100:00100000:3.0:1787781946.559343:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787781946.559351:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023761664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781946.559380:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781946.559436:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023761664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.559443:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787781946.559464:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023762176 00000100:00100000:3.0:1787781946.559468:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023762176 00000100:00100000:3.0:1787781946.559495:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787781946.559502:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023762176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781946.559546:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023762176:12345-0@lo:400:kworker.0 Request processed in 44us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.559552:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787781946.559568:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023761792 00000100:00100000:3.0:1787781946.559571:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023761792 00000100:00100000:3.0:1787781946.559605:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787781946.559611:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023761792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781946.559635:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023761792:12345-0@lo:400:kworker.0 Request processed in 26us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781946.559639:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:1.0:1787781946.559710:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787781946.559713:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787781946.560088:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023761792:0@lo:400:kworker.0 00010000:00080000:2.0:1787781946.560102:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef448b40000 x1874625023762176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781946.560111:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023762176:0@lo:400:kworker.0 00000100:00100000:2.0:1787781946.560121:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787781946.560126:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef476779680, transno 4294967300 00000100:00100000:2.0:1787781946.560153:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023761664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787781946.622177:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781947.070264:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787781947.070305:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023762432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781947.070379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781947.070629:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023762432 00000100:00100000:3.0:1787781947.070638:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023762432 00000100:00100000:3.0:1787781947.070693:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787781947.070703:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023762432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781947.070740:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781947.070822:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023762432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781947.070829:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787781947.071044:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef478dbcb40 x1874625023762432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781947.071064:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023762432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787781947.647146:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781948.670032:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781949.694197:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781950.412640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781950.412687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781950.412819:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005903232 00000100:00100000:2.0:1787781950.412828:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005903232 00000100:00100000:2.0:1787781950.412887:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 278 00000100:00100000:2.0:1787781950.412897:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4464e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005903232:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781950.412969:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4464e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005903232:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781950.412977:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 278 00000100:00100000:1.0:1787781950.413089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781950.413124:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781950.413146:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005903360 00000100:00100000:2.0:1787781950.413150:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005903360 00000100:00100000:1.0:1787781950.413155:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005903616 00000100:00100000:1.0:1787781950.413161:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005903616 00000100:00100000:1.0:1787781950.413203:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:1.0:1787781950.413212:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005903616:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781950.413473:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2351:x1874625005903616:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 261us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781950.413490:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:3.0:1787781950.419573:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005903488 00000100:00100000:3.0:1787781950.419591:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005903488 00000100:00100000:2.0:1787781950.419866:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:2.0:1787781950.419877:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005903360:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781950.423217:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005903360:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 3329us (10116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781950.423231:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00080000:0.0:1787781950.423724:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781950.423731:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781950.426985:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1787781950.427000:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005903488:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781950.427095:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005903488:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 100us (14407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781950.427101:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00010000:00010000:1.0:1787781950.718388:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781951.678229:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023762688:0@lo:400:kworker.0 00000100:00100000:2.0:1787781951.678308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781951.678385:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023763200:0@lo:400:kworker.0 00000100:00100000:2.0:1787781951.678416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781951.678621:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023762560:0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.678674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781951.678700:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023763072:0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.678721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781951.678745:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787781951.678750:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023762944:0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.678773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781951.678823:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023762560 00000100:00100000:0.0:1787781951.678831:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023762560 00000100:00100000:0.0:1787781951.678888:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787781951.678897:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023762560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.678945:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023762560:12345-0@lo:400:kworker.0 Request processed in 49us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.678952:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787781951.678983:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023762688 00000100:00100000:0.0:1787781951.678987:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023762688 00000100:00100000:0.0:1787781951.679008:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023763072 00000100:00100000:0.0:1787781951.679011:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023763072 00000100:00100000:0.0:1787781951.679038:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787781951.679046:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023762688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.679079:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023762688:12345-0@lo:400:kworker.0 Request processed in 35us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.679085:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787781951.679097:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787781951.679102:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476779680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023763072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.679129:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476779680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023763072:12345-0@lo:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.679144:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787781951.679163:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023763200 00000100:00100000:0.0:1787781951.679167:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023763200 00000100:00100000:0.0:1787781951.679192:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023762944 00000100:00100000:0.0:1787781951.679194:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023762944 00000100:00100000:0.0:1787781951.679211:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787781951.679218:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023763200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.679248:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023763200:12345-0@lo:400:kworker.0 Request processed in 31us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.679254:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787781951.679264:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787781951.679270:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023762944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.679296:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023762944:12345-0@lo:400:kworker.0 Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781951.679301:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787781951.679329:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781951.679333:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781951.679336:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787781951.679372:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef448b42580 x1874625023762944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781951.679387:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023762944:0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.679397:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023762560:0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.679405:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023763072:0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.679449:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625023762816:0@lo:400:kworker.0 00000100:00100000:2.0:1787781951.679696:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b42940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023762688:0@lo:400:kworker.0 00000100:00100000:2.0:1787781951.679706:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023763200:0@lo:400:kworker.0 00000100:00100000:0.0:1787781951.680733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781951.680804:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023763328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781951.680837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781951.681070:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023762816 00000100:00100000:3.0:1787781951.681076:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023762816 00000100:00100000:3.0:1787781951.681133:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787781951.681142:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4767792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625023762816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781951.681186:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4767792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625023762816:12345-0@lo:400:kworker.0 Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781951.681204:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787781951.681411:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b41e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625023762816:0@lo:400:kworker.0 00000100:00080000:2.0:1787781951.681750:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781951.688698:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023763328 00000100:00100000:1.0:1787781951.688711:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023763328 00000100:00100000:1.0:1787781951.688785:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787781951.688812:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023763328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787781951.688851:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787781951.688959:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023763328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (8120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781951.688980:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787781951.689288:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023763328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787781951.742602:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781952.190400:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023763456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781952.190484:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781952.190554:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023763456 00000100:00100000:2.0:1787781952.191321:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023763456 00000100:00100000:2.0:1787781952.191375:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787781952.191385:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023763456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781952.191423:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781952.191534:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b42940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023763456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781952.191543:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787781952.192203:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef448b40b40 x1874625023763456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781952.192223:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b40b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023763456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781952.766199:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781953.790373:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787781954.814677:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787781954.815073:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781955.526429:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781955.526648:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005903744 00000100:00100000:0.0:1787781955.526658:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005903744 00000100:00100000:0.0:1787781955.526716:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 280 00000100:00100000:0.0:1787781955.526726:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005903744:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781955.526845:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2351:x1874625005903744:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 121us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781955.526853:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 280 00000100:00100000:3.0:1787781955.528189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781955.528487:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005903872 00000100:00100000:0.0:1787781955.528495:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005903872 00000100:00100000:0.0:1787781955.528569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:0.0:1787781955.528580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005903872:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781955.529340:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005903872:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 758us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781955.529350:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00080000:2.0:1787781955.531004:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781955.563134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781955.563185:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781955.563288:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005904128 00000100:00100000:3.0:1787781955.563299:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005904128 00000100:00100000:3.0:1787781955.563386:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00100000:3.0:1787781955.563676:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2352:x1874625005904128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781955.563774:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2352:x1874625005904128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 103us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781955.563782:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00080000:2.0:1787781955.564720:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781955.569965:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005904000 00000100:00100000:0.0:1787781955.569981:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005904000 00000100:00100000:0.0:1787781955.570067:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:0.0:1787781955.570077:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2348:x1874625005904000:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:0.0:1787781955.570109:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c9045418f 00000100:00080000:0.0:1787781955.570118:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ef4809a8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787781955.570166:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787781955.570491:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+2:2348:x1874625005904000:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 414us (7304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781955.570513:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00010000:00010000:1.0:1787781955.571864:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787781955.572430:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787781955.834365:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:0.0:1787781955.834376:0:7652:0:(genops.c:885:class_export_put()) final put ffff9ef4809ae000/3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:2.0:1787781955.837684:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef4809ae000/3fd2e199-5730-414f-9ae9-e4e10b451cbf for lustre-OST0001 00000020:00000080:2.0:1787781955.837768:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef4809a8000 for lustre-OST0001 00010000:00010000:2.0:1787781955.839331:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781956.798048:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023763840:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.798061:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023763712:0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.798134:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023763968:0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.798207:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023763584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781956.811237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.811315:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023764224:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.811364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.811402:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781956.811409:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023764352:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.811452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.811508:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023764224 00000100:00100000:1.0:1787781956.811517:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023764224 00000100:00100000:1.0:1787781956.811579:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787781956.811588:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023764224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.811639:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023764224:12345-0@lo:400:kworker.0 Request processed in 52us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.811646:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1787781956.811665:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781956.811695:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023764224:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.811727:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023764352 00000100:00100000:1.0:1787781956.811731:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023764352 00000100:00100000:1.0:1787781956.811774:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787781956.811779:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023764352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.811835:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023764352:12345-0@lo:400:kworker.0 Request processed in 55us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.811842:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787781956.811858:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023763712 00000100:00100000:1.0:1787781956.811861:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023763712 00000100:00100000:1.0:1787781956.811882:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787781956.811888:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023763712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.811916:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023763712:12345-0@lo:400:kworker.0 Request processed in 28us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.811922:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1787781956.811947:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781956.811963:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023764352:0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.811972:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023763712:0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.818047:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781956.818125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781956.818246:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023763968 00000100:00100000:0.0:1787781956.818252:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023763840 00000100:00100000:1.0:1787781956.818256:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023763968 00000100:00100000:0.0:1787781956.818256:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023763840 00000100:00100000:1.0:1787781956.818314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1787781956.818316:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781956.818324:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476779e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023763968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781956.818393:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476779e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023763968:12345-0@lo:400:kworker.0 Request processed in 70us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781956.818401:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787781956.818482:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023763968:0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.818587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781956.818622:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476f08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023764096:0@lo:400:kworker.0 00000100:00100000:2.0:1787781956.818650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781956.818894:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023763584 00000100:00100000:3.0:1787781956.818899:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023763584 00000100:00100000:3.0:1787781956.818941:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787781956.818948:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023763584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781956.818978:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781956.819017:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023763584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781956.819022:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787781956.819120:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023763584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781956.819251:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787781956.819260:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023763840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.819486:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023763840:12345-0@lo:400:kworker.0 Request processed in 228us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781956.819493:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787781956.819513:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023764096 00000100:00100000:0.0:1787781956.819517:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023764096 00000100:00100000:0.0:1787781956.819560:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787781956.819566:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023764096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781956.819601:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023764096:12345-0@lo:400:kworker.0 Request processed in 35us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781956.819607:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787781956.820963:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787781956.821010:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef476f08b40 x1874625023764096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787781956.821024:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476f08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023764096:0@lo:400:kworker.0 00000100:00100000:3.0:1787781956.821521:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023763840:0@lo:400:kworker.0 00010000:00010000:1.0:1787781956.868096:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781957.310281:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023764480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787781957.310365:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781957.310543:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023764480 00000100:00100000:2.0:1787781957.310551:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023764480 00000100:00100000:2.0:1787781957.310606:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787781957.310616:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023764480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781957.310652:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781957.310709:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023764480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781957.310716:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787781957.310828:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef448b42d00 x1874625023764480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787781957.310847:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023764480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781957.886162:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781958.910580:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781959.934196:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781960.648834:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781960.648937:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781960.649469:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005904384 00000100:00100000:0.0:1787781960.649478:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005904384 00000100:00100000:0.0:1787781960.649569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:0.0:1787781960.649580:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005904384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781960.650032:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005904384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 453us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781960.650053:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00080000:2.0:1787781960.652446:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781960.654811:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005904256 00000100:00100000:3.0:1787781960.654824:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005904256 00000100:00100000:3.0:1787781960.654875:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00100000:3.0:1787781960.654885:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005904256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781960.661629:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005904256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 6731us (12834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781960.661645:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 282 00000100:00100000:0.0:1787781960.669680:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781960.675963:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005904512 00000100:00100000:3.0:1787781960.675977:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005904512 00000100:00100000:3.0:1787781960.676074:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:3.0:1787781960.676084:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005904512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781960.676173:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005904512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 91us (6502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781960.676181:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00080000:2.0:1787781960.676359:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787781960.960987:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781961.918077:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781961.918107:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef46205b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023764608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781961.918195:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781961.920550:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023764608 00000100:00100000:3.0:1787781961.920563:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023764608 00000100:00100000:3.0:1787781961.920641:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787781961.920652:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023764608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781961.920696:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781961.920777:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023764608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781961.920785:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787781961.920934:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023764736:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.920986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.921022:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f49b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023765248:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.921052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.921078:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781961.921084:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f498b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023764864:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.921105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781961.921140:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023764736 00000100:00100000:0.0:1787781961.921144:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023764736 00000100:00100000:0.0:1787781961.921175:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787781961.921182:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023764736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.921218:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023764736:12345-0@lo:400:kworker.0 Request processed in 36us (231us total) trans 0 rc 0/0 00000100:00080000:3.0:1787781961.921827:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781961.922602:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787781961.922657:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023765248 00000100:00100000:0.0:1787781961.922664:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023765248 00000100:00080000:3.0:1787781961.923107:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781961.923989:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023764864 00000100:00100000:0.0:1787781961.924000:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023764864 00000100:00100000:2.0:1787781961.924652:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787781961.924669:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023765248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781961.924784:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023765248:12345-0@lo:400:kworker.0 Request processed in 122us (3731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781961.924814:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787781961.924838:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787781961.924859:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f498f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023764864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781961.924893:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f498f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023764864:12345-0@lo:400:kworker.0 Request processed in 37us (3787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781961.924899:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787781961.925075:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f49bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023765120:0@lo:400:kworker.0 00000100:00100000:1.0:1787781961.925126:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781961.925167:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787781961.925174:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f4992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023764992:0@lo:400:kworker.0 00000100:00100000:1.0:1787781961.925195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781961.925237:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023765120 00000100:00100000:1.0:1787781961.925243:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023765120 00000100:00100000:1.0:1787781961.925291:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787781961.925298:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023765120:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787781961.926022:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781961.926039:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023764992 00000100:00100000:2.0:1787781961.926043:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023764992 00000100:00100000:2.0:1787781961.926087:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787781961.926095:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023764992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.926581:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f498b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023764864:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.926595:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023764736:0@lo:400:kworker.0 00000100:00100000:0.0:1787781961.926607:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f49b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023765248:0@lo:400:kworker.0 00010000:00080000:0.0:1787781961.926684:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47f49bc00 x1874625023765120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781961.926707:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f49bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023765120:0@lo:400:kworker.0 00000100:00100000:2.0:1787781961.926828:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023764992:12345-0@lo:400:kworker.0 Request processed in 733us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781961.926837:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1787781961.926922:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781961.926964:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef46205b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023764608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781961.927149:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f4992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023764992:0@lo:400:kworker.0 00000100:00100000:1.0:1787781961.927218:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023765120:12345-0@lo:400:kworker.0 Request processed in 1918us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781961.927296:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1787781961.987605:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781962.431018:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781962.431050:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023765376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781962.431149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781962.431483:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023765376 00000100:00100000:3.0:1787781962.431493:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023765376 00000100:00100000:3.0:1787781962.431560:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787781962.431572:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023765376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781962.431619:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781962.431684:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023765376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781962.431692:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787781962.432359:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44aa3cb40 x1874625023765376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781962.432405:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023765376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787781963.021568:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781964.029940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781964.099488:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787781965.066024:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781965.775960:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781965.776021:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781965.776064:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781965.776114:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005904896 00000100:00100000:1.0:1787781965.776128:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005904896 00000100:00100000:1.0:1787781965.776380:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005904768 00000100:00100000:1.0:1787781965.776385:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005904768 00000100:00100000:1.0:1787781965.776419:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:1.0:1787781965.776430:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2349:x1874625005904896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781965.776543:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2349:x1874625005904896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 114us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781965.776565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:1.0:1787781965.776585:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:1.0:1787781965.776593:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2349:x1874625005904768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781965.776624:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2349:x1874625005904768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781965.776631:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00080000:1.0:1787781965.776657:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781965.777161:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005904640 00000100:00100000:3.0:1787781965.777169:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005904640 00000100:00100000:3.0:1787781965.778416:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 284 00000100:00100000:3.0:1787781965.778436:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2349:x1874625005904640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781965.778510:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2349:x1874625005904640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 83us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781965.778519:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 284 00000001:02000400:1.0:1787781965.852522:0:11859:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:06:05 (1787781965) 00010000:00010000:1.0:1787781966.080128:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781967.041109:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f49b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023765760:0@lo:400:kworker.0 00000100:00100000:0.0:1787781967.041181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781967.041250:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781967.041257:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023765888:0@lo:400:kworker.0 00000100:00100000:0.0:1787781967.041283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781967.041318:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023765760 00000100:00100000:0.0:1787781967.041324:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023765760 00000100:00100000:0.0:1787781967.041388:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787781967.041398:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023765760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781967.041447:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023765760:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.041454:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787781967.041476:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023765888 00000100:00100000:0.0:1787781967.041479:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023765888 00000100:00100000:0.0:1787781967.041507:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787781967.041513:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f499e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023765888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781967.041540:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f499e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023765888:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.041546:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787781967.041593:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47f499a40 x1874625023765888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787781983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781967.041606:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023765888:0@lo:400:kworker.0 00000100:00100000:0.0:1787781967.041617:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f49b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023765760:0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.043507:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f49bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023765632:0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.043569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781967.043615:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f498780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023766144:0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.043641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781967.043676:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787781967.043682:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f49a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023765504:0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.043709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781967.043733:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f498b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023766016:0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.043754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787781967.043780:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787781967.043813:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781967.043827:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023765632 00000100:00100000:1.0:1787781967.043832:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023765632 00000100:00100000:1.0:1787781967.043870:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023766016 00000100:00100000:1.0:1787781967.043873:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023766016 00000100:00100000:1.0:1787781967.043898:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787781967.043918:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023765632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.043967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023765632:12345-0@lo:400:kworker.0 Request processed in 50us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781967.043974:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787781967.043990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787781967.043996:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023766016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.044022:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023766016:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781967.044027:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787781967.044043:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023765504 00000100:00100000:1.0:1787781967.044046:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023765504 00000100:00100000:1.0:1787781967.044068:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787781967.044074:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023765504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.044102:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023765504:12345-0@lo:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781967.044108:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:1.0:1787781967.044134:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781967.044157:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f49a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023765504:0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.044169:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f498b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023766016:0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.044178:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f49bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023765632:0@lo:400:kworker.0 00000100:00100000:3.0:1787781967.044714:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781967.044725:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023766272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781967.044761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781967.044808:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023766272 00000100:00100000:3.0:1787781967.044812:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023766272 00000100:00100000:3.0:1787781967.044847:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787781967.044854:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023766272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781967.044883:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781967.044919:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023766272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781967.044934:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787781967.045027:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787781967.045131:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023766144 00000100:00100000:2.0:1787781967.045154:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023766144 00000100:00100000:2.0:1787781967.045221:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787781967.045231:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023766144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781967.045317:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023766144:12345-0@lo:400:kworker.0 Request processed in 89us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781967.045349:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787781967.045410:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f498780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023766144:0@lo:400:kworker.0 00000100:00100000:1.0:1787781967.045514:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023766272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787781967.109117:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781967.419125:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781967.419409:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005905024 00000100:00100000:2.0:1787781967.419423:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005905024 00000100:00100000:2.0:1787781967.419558:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:2.0:1787781967.419571:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:10232:x1874625005905024:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781967.419601:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781967.419787:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045425a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d8ff expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.419912:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454261 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.419926:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454261 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.419939:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454261 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787781967.419979:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787781967.420134:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787781967.420139:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781967.420229:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454261 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.420264:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045425a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ff expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.420279:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454261 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ff expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781967.420297:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781967.420300:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781967.420303:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414600, rc 0) 00000100:00100000:2.0:1787781967.420468:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:10232:x1874625005905024:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 899us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781967.420477:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:1.0:1787781967.430491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781967.430892:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005905152 00000100:00100000:0.0:1787781967.430904:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005905152 00000100:00100000:0.0:1787781967.430998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:0.0:1787781967.431012:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:10233:x1874625005905152:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781967.431042:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781967.431073:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454268 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d906 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.431159:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.431190:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.431203:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.431220:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.431227:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.431233:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432218:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030800/0x3ad9816c9045427d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432235:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030800/0x3ad9816c9045427d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432244:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030800/0x3ad9816c9045427d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781967.432355:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787781967.432359:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787781967.432451:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030800/0x3ad9816c9045427d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432465:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432472:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432479:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432486:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781967.432491:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432500:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432516:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:0.0:1787781967.432527:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781967.432533:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432540:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045426f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432556:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432562:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432567:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432572:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781967.432576:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432582:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432590:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ef44a9a7400) 00010000:00010000:0.0:1787781967.432593:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781967.432596:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.432601:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454276 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.434224:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454268 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d906 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.434298:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030800/0x3ad9816c9045427d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d906 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781967.434309:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef44a9a7800) 00010000:00010000:0.0:1787781967.434312:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781967.434316:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030800, rc 0) 00000100:00100000:0.0:1787781967.434436:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:10233:x1874625005905152:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3425us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.434447:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:3.0:1787781967.451390:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781967.451502:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005905408 00000100:00100000:1.0:1787781967.451520:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005905408 00000100:00100000:1.0:1787781967.451607:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:1.0:1787781967.451622:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:10233:x1874625005905408:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781967.451651:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781967.451677:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f000/0x3ad9816c90454284 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d90d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.451824:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.451841:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.451854:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.452032:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.452053:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.452064:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.452634:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c90454299 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.452645:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c90454299 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.452663:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c90454299 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781967.452675:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787781967.454197:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454211:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454219:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454225:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781967.454229:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454237:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454254:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef44a9a7800) 00010000:00010000:1.0:1787781967.454257:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781967.454262:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454269:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045428b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454285:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454291:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454310:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454315:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781967.454318:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454326:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454344:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ef448467700) 00010000:00010000:1.0:1787781967.454347:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781967.454350:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454356:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454292 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.454772:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f000/0x3ad9816c90454284 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d90d expref: 10 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.455872:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c90454299 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d90d expref: 9 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781967.455884:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:1.0:1787781967.455887:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781967.455891:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e000, rc 0) 00000100:00100000:1.0:1787781967.455971:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:10233:x1874625005905408:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4352us (4588us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787781967.455992:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:2.0:1787781967.462002:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781967.462065:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005905536 00000100:00100000:0.0:1787781967.462077:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005905536 00000100:00100000:0.0:1787781967.462367:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:0.0:1787781967.462378:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:10233:x1874625005905536:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787781967.462495:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:10233:x1874625005905536:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 119us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781967.462503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:1.0:1787781967.550124:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44aa3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023766400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781967.550219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781967.550602:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023766400 00000100:00100000:3.0:1787781967.550610:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023766400 00000100:00100000:3.0:1787781967.550667:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787781967.550677:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023766400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781967.550714:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781967.550769:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023766400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781967.550777:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787781967.550907:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef44aa3e1c0 x1874625023766400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787781983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781967.550925:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44aa3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023766400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787781968.126073:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781968.194467:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787781969.153438:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781969.457199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781969.457941:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005905664 00000100:00100000:2.0:1787781969.457957:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005905664 00000100:00100000:2.0:1787781969.458057:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:2.0:1787781969.458072:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f4983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:10276:x1874625005905664:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781969.458093:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787781969.458122:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787781969.458188:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904542a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d914 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458264:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458279:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458293:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458307:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458341:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458348:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458609:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458618:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458625:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458630:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781969.458634:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458642:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458655:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781969.458658:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781969.458663:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458669:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904542ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458681:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458693:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458698:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458703:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781969.458706:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458712:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458720:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ef45088a300) 00010000:00010000:2.0:1787781969.458723:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781969.458726:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458731:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904542b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458764:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904542a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d914 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458775:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781969.458777:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781969.458781:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904542a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d914 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.458825:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414400, rc 0) 00000100:00100000:2.0:1787781969.458911:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f4983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:10276:x1874625005905664:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 843us (1729us total) trans 0 rc 301/301 00000100:00100000:2.0:1787781969.458920:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:3.0:1787781969.466727:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781969.467422:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005905920 00000100:00100000:1.0:1787781969.467437:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005905920 00000100:00100000:1.0:1787781969.467636:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:1.0:1787781969.467648:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:10276:x1874625005905920:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:1.0:1787781969.467708:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781969.467736:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454261 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8ff expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.467754:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:1.0:1787781969.467764:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781969.468104:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.470586:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.470603:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.470634:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.470654:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.470662:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781969.471878:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787781969.471893:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.471902:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.471909:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.471915:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781969.471919:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.471927:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.471940:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:1.0:1787781969.471943:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781969.471948:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.471954:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542bc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781969.471984:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071dbd014 reply state 000000001b5a2e3e transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781969.471993:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787781969.472118:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:10276:x1874625005905920:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 4468us (5394us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787781969.472128:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00010000:00010000:1.0:1787781969.478949:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.478968:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.478976:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.478983:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781969.478987:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.478995:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.479012:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ef448467b00) 00010000:00010000:1.0:1787781969.479015:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781969.479020:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.479027:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542c3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.566568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781969.566606:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005906048 00000100:00100000:3.0:1787781969.566615:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005906048 00000100:00100000:3.0:1787781969.566673:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:3.0:1787781969.566683:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:10284:x1874625005906048:12345-192.168.202.56@tcp:101:lctl.0 00010000:00010000:3.0:1787781969.566709:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781969.566732:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c904542ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d91b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.566817:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904542d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.566831:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904542d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.566853:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904542d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781969.566913:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787781969.566917:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781969.566961:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904542d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.566986:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c904542ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d91b expref: 11 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.567001:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904542d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d91b expref: 10 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781969.567009:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:3.0:1787781969.567012:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781969.567015:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2c00, rc 0) 00000100:00100000:3.0:1787781969.567072:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:10284:x1874625005906048:12345-192.168.202.56@tcp:101:lctl.0 Request processed in 390us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781969.567080:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:2.0:1787781969.647573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781969.647685:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005906176 00000100:00100000:1.0:1787781969.647694:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005906176 00000100:00100000:1.0:1787781969.647758:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:1.0:1787781969.647770:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:10290:x1874625005906176:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1787781969.647823:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781969.647845:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d922 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.647911:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.647927:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.647940:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.647955:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.647963:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.647971:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648080:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904542ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648088:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904542ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648108:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904542ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781969.648145:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787781969.648148:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787781969.648189:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904542ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648202:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648208:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648214:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648219:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781969.648223:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648230:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648241:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:1.0:1787781969.648244:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781969.648248:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648255:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904542df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648280:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648285:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648290:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648295:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781969.648298:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648304:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648323:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ef448467b00) 00010000:00010000:1.0:1787781969.648326:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781969.648329:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648335:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904542e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648365:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904542d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d922 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648393:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904542ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d922 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.648411:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:1.0:1787781969.648414:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787781969.648416:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f400, rc 0) 00000100:00100000:1.0:1787781969.648479:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:10290:x1874625005906176:12345-192.168.202.56@tcp:101:bash.0 Request processed in 710us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781969.648486:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:3.0:1787781969.652730:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781969.652839:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005906432 00000100:00100000:0.0:1787781969.652854:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005906432 00000100:00100000:0.0:1787781969.652935:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:0.0:1787781969.652947:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:10290:x1874625005906432:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1787781969.652969:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781969.652995:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c904542f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d929 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.653177:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.653192:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.653204:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.653280:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.653502:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.653515:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787781969.656838:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787781969.657044:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657062:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657075:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657112:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657130:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657137:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657143:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781969.657147:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657154:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657167:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:0.0:1787781969.657169:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781969.657174:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657179:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904542fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781969.657193:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000254e2756 reply state 000000000fa85c9e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781969.657202:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787781969.657239:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c904542f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d929 expref: 14 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657253:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d929 expref: 13 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.657272:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7900) 00010000:00010000:0.0:1787781969.657275:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781969.657277:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031800, rc 0) 00000100:00100000:0.0:1787781969.659894:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:10290:x1874625005906432:12345-192.168.202.56@tcp:101:bash.0 Request processed in 6937us (7167us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787781969.659906:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00010000:00010000:1.0:1787781969.669525:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.669543:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.669550:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.669556:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781969.669561:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.669568:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.669585:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef44a9a7400) 00010000:00010000:1.0:1787781969.669588:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781969.669593:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.669599:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454302 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781969.673992:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781969.674078:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005906560 00000100:00100000:0.0:1787781969.674093:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005906560 00000100:00100000:0.0:1787781969.674229:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:0.0:1787781969.674239:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a763c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1874625005906560:12345-192.168.202.56@tcp:8:bash.0 00010000:00080000:0.0:1787781969.674272:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:0.0:1787781969.674332:0:6695:0:(genops.c:1385:class_connect()) connect: client 3fd2e199-5730-414f-9ae9-e4e10b451cbf, cookie 0x3ad9816c90454317 00002000:00100000:0.0:1787781969.674345:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3fd2e199-5730-414f-9ae9-e4e10b451cbf/ffff9ef444e5c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787781969.674370:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787781969.674591:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787781969.674627:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ef444e5b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781969.674704:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a763c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2348:x1874625005906560:12345-192.168.202.56@tcp:8:bash.0 Request processed in 464us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781969.674713:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:3.0:1787781969.679733:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781969.680278:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005906688 00000100:00100000:2.0:1787781969.680306:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005906688 00000100:00100000:2.0:1787781969.680477:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1787781969.680488:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:0:x1874625005906688:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781969.680505:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781969.680527:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d930 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781969.680554:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787781969.680571:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1787781969.680576:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781969.680586:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d930 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.680606:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d930 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.680619:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415400, rc 0) 00000100:00100000:2.0:1787781969.680694:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:0:x1874625005906688:12345-192.168.202.56@tcp:101:bash.0 Request processed in 208us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781969.680702:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00080000:3.0:1787781969.684734:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781969.687174:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781969.687934:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005906816 00000100:00100000:2.0:1787781969.687968:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005906816 00000100:00100000:2.0:1787781969.688042:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:2.0:1787781969.688054:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:10290:x1874625005906816:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781969.688079:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781969.688104:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d937 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.688145:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d930 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.688168:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781969.688173:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781969.688180:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.688223:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d930 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.688240:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d930 expref: 8 pid: 6697 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.688256:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b42d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874625023766528:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781969.688390:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787781969.692411:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781969.692529:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b42d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874625023766528:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781969.692578:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005906944 00000100:00100000:1.0:1787781969.692588:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005906944 00010000:00010000:2.0:1787781969.692596:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.692636:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d930 expref: 9 pid: 6697 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.692664:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:1.0:1787781969.692689:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:1.0:1787781969.692703:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2352:x1874625005906944:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781969.692723:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781969.692749:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d930 expref: 9 pid: 6697 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.692770:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d930 expref: 9 pid: 6697 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.692772:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:10290:x1874625005906816:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4715us (5619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781969.692854:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00010000:00010000:1.0:1787781969.692870:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075c74108/0x3ad9816c9045431e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d930 expref: 9 pid: 6697 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.692894:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781969.692899:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781969.692909:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.692929:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.692989:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781969.693006:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f9e52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1874625023766656:192.168.202.56@tcp:105: 00000100:00100000:1.0:1787781969.693082:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781969.695613:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f9e52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1874625023766656:192.168.202.56@tcp:105: 00010000:00010000:1.0:1787781969.695639:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781969.695698:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005906944:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2997us (3295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781969.695708:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:0.0:1787781969.697553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781969.697655:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005907200 00000100:00100000:2.0:1787781969.697666:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005907200 00000100:00100000:2.0:1787781969.697736:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1787781969.697747:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:10290:x1874625005907200:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:2.0:1787781969.698882:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:10290:x1874625005907200:12345-192.168.202.56@tcp:35:bash.0 Request processed in 1129us (1335us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787781969.698894:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:0.0:1787781969.823280:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781969.823730:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005907456 00000100:00100000:1.0:1787781969.823745:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005907456 00000100:00100000:1.0:1787781969.823841:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:1.0:1787781969.823849:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f499680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:10300:x1874625005907456:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781969.823876:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781969.823897:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c9045432c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d93e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781969.824007:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787781969.824141:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c9045432c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d93e expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.824156:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:1.0:1787781969.824160:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781969.824181:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c9045432c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d93e expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.824196:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183ea00, rc 0) 00000100:00100000:1.0:1787781969.824265:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f499680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:10300:x1874625005907456:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 416us (1009us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787781969.824273:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:0.0:1787781969.831876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781969.836829:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005907712 00000100:00100000:3.0:1787781969.836850:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005907712 00000100:00100000:3.0:1787781969.837003:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1787781969.837034:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:10300:x1874625005907712:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781969.838987:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:10300:x1874625005907712:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 1944us (7114us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787781969.839001:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1787781969.952113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781969.952210:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005907840 00000100:00100000:2.0:1787781969.952222:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005907840 00000100:00100000:2.0:1787781969.952323:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:2.0:1787781969.952336:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:10306:x1874625005907840:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781969.952368:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781969.952408:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c9045433a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d945 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.952505:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.952534:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.952549:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781969.952629:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787781969.952633:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781969.952662:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.952695:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c9045433a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d945 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.952720:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d945 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.952730:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781969.952734:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781969.952738:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414400, rc 0) 00000100:00100000:2.0:1787781969.952876:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:10306:x1874625005907840:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 543us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781969.952885:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:1.0:1787781969.960390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781969.962349:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005908096 00000100:00100000:0.0:1787781969.962369:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005908096 00000100:00100000:0.0:1787781969.962541:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:0.0:1787781969.962563:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:10306:x1874625005908096:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787781969.962591:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781969.962622:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454348 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d94c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.962755:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045434f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.962774:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045434f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.962805:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045434f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781969.962821:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787781969.962995:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454348 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d94c expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.963021:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045434f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d94c expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.963030:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7900) 00010000:00010000:0.0:1787781969.963033:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781969.963037:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030e00, rc 0) 00000100:00100000:0.0:1787781969.963136:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:10306:x1874625005908096:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 575us (2763us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787781969.963174:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:3.0:1787781969.968603:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781969.968670:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781969.968725:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005908224 00000100:00100000:2.0:1787781969.968737:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005908224 00000100:00100000:2.0:1787781969.968837:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1787781969.968849:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:2352:x1874625005908224:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781969.968870:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781969.968923:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045434f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d94c expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781969.968947:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7900) 00010000:00010000:2.0:1787781969.968954:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781969.969025:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:2352:x1874625005908224:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 178us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781969.969033:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1787781969.973373:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005908480 00000100:00100000:1.0:1787781969.973393:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005908480 00000100:00100000:1.0:1787781969.973500:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:1.0:1787781969.973512:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:10306:x1874625005908480:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781969.975396:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781969.975443:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c9045435d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d953 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.975593:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454364 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.975611:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.975626:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781969.975640:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787781969.975825:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c9045435d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d953 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.975851:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d953 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781969.975879:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7900) 00010000:00010000:1.0:1787781969.975883:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787781969.975887:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f200, rc 0) 00000100:00100000:1.0:1787781969.975980:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10306:x1874625005908480:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2469us (7308us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787781969.975990:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:2.0:1787781969.981072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781969.981180:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005908608 00000100:00100000:0.0:1787781969.981193:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005908608 00000100:00100000:0.0:1787781969.981273:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:0.0:1787781969.981285:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2351:x1874625005908608:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:0.0:1787781969.981382:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.981409:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.981419:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781969.981424:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781969.981429:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.981472:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.981489:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781969.981507:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874625023766784:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781969.981877:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4412edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787781969.985442:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874625023766784:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781969.985502:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781969.986172:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781969.987290:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005908736 00000100:00100000:0.0:1787781969.987305:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005908736 00002000:00100000:0.0:1787781969.987385:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9ef448b41e00 x1874625005908736/t0(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:115/0 lens 504/0 e 0 to 0 dl 1787781980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787781969.987399:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef448b41e00 with x1874625005908736 ext(0->12) 00010000:00010000:0.0:1787781969.987411:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 8 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781969.987429:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 8 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787781969.987437:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ef448b41e00 00000100:00100000:0.0:1787781969.987476:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:0.0:1787781969.987487:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005908736:12345-192.168.202.56@tcp:4:lfs.0 00000001:00100000:0.0:1787781970.009429:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000100:00100000:1.0:1787781970.032420:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b41e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2351:x1874625005908736:12345-192.168.202.56@tcp:4:lfs.0 Request processed in 44924us (46248us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787781970.032450:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00002000:00100000:1.0:1787781970.032462:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9ef448b41e00 x1874625005908736/t4294967299(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:115/0 lens 504/448 e 0 to 0 dl 1787781980 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781970.032472:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef448b41e00 with x1874625005908736 ext(0->12) 00010000:00010000:1.0:1787781970.032482:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 9 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.032501:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 9 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787781970.032516:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ef448b41e00 00000001:00080000:2.0:1787781970.032656:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1787781970.034932:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781970.035108:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005908864 00000100:00100000:1.0:1787781970.035115:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005908864 00010000:00010000:1.0:1787781970.035145:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781970.035357:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:1.0:1787781970.035379:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2349:x1874625005908864:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781970.035395:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787781970.035417:0:8462:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787781970.035421:0:8462:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787781970 00002000:00010000:1.0:1787781970.035423:0:8462:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787781970 00002000:00010000:1.0:1787781970.035425:0:8462:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787781970 00002000:00010000:1.0:1787781970.035428:0:8462:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787781970.035434:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.035449:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.035471:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454325 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d937 expref: 7 pid: 6694 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.035487:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781970.035492:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781970.035498:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.035508:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.035545:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781970.035592:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2349:x1874625005908864:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 214us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781970.035609:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00010000:00010000:0.0:1787781970.035680:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.035691:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.035712:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.035728:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.035735:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.035741:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787781970.035746:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.035755:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.035770:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.035778:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aa6227d/0x3ad9816c90454372 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781970.036077:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005908608:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 54793us (55020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781970.036086:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:3.0:1787781970.042010:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781970.042228:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005909120 00000100:00100000:2.0:1787781970.042237:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005909120 00000100:00100000:2.0:1787781970.042292:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1787781970.042301:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10306:x1874625005909120:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:2.0:1787781970.042378:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d953 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781970.042703:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787781970.042771:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787781970.043400:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787781970.043460:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.043475:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d929 expref: 24 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.043485:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.043528:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d929 expref: 24 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.043543:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d929 expref: 24 pid: 9081 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781970.043557:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b41a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874625023766912:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781970.043646:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781970.053175:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781970.053240:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005909248 00000100:00100000:0.0:1787781970.053249:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005909248 00000100:00100000:2.0:1787781970.053290:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b41a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874625023766912:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781970.053291:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d929 expref: 25 pid: 9081 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.053329:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781970.053363:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:0.0:1787781970.053373:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:2352:x1874625005909248:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781970.053388:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781970.053396:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d929 expref: 25 pid: 9081 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.053408:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d929 expref: 25 pid: 9081 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.053430:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454309 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d929 expref: 25 pid: 9081 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.053446:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7900) 00010000:00010000:0.0:1787781970.053452:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.053462:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.053469:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.053487:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781970.053543:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:2352:x1874625005909248:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 170us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781970.053551:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00010000:00010000:2.0:1787781970.053773:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.054002:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787781970.054231:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787781970.054436:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787781970.054567:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023767040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787781970.054671:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781970.054698:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef441254a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781970.055056:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023767040 00000100:00100000:2.0:1787781970.055060:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023767040 00000100:00100000:2.0:1787781970.055102:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787781970.055108:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874625023767040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787781970.055177:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874625023767040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 69us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781970.055185:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787781970.055209:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a04780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023767040:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787781970.055584:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787781970.055828:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787781970.055884:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023767168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787781970.055917:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781970.056083:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023767168 00000100:00100000:2.0:1787781970.056087:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023767168 00000100:00100000:0.0:1787781970.056092:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef473d59180 going to sleep for 11 seconds 00000100:00100000:2.0:1787781970.056157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787781970.056163:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f498780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874625023767168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787781970.056385:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f498780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874625023767168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 222us (467us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787781970.056402:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787781970.056471:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023767168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787781970.056527:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787781970.056560:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.056570:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.056580:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.056586:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781970.056590:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.056598:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.056613:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7900) 00010000:00010000:0.0:1787781970.056617:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787781970.056622:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781970.056629:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454379 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787781970.056845:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787781970.057059:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787781970.057070:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337835280223ns, next at 338835278301ns, rc = 0 00000001:00080000:0.0:1787781970.057076:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787781970.057104:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7900) 00010000:00010000:0.0:1787781970.057108:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787781970.057114:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454364 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d953 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781970.057211:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10306:x1874625005909120:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 14911us (15211us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787781970.057220:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000020:00080000:0.0:1787781970.057224:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787781970.063069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781970.063106:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005909376 00000100:00100000:3.0:1787781970.063117:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005909376 00000100:00100000:3.0:1787781970.063273:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:3.0:1787781970.063284:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10306:x1874625005909376:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781970.063339:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781970.063358:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454380 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d95a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.063594:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d95a expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.063605:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d95a expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.063620:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:3.0:1787781970.063633:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781970.063683:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3000, rc 0) 00000100:00100000:3.0:1787781970.063780:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:10306:x1874625005909376:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 497us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781970.063866:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:3.0:1787781970.068108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781970.068214:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005909632 00000100:00100000:0.0:1787781970.068223:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005909632 00000100:00100000:0.0:1787781970.068277:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:0.0:1787781970.068287:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff2e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:10306:x1874625005909632:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1787781970.069105:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff2e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:10306:x1874625005909632:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 811us (997us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787781970.069115:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:0.0:1787781970.159052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781970.159172:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005909888 00000100:00100000:1.0:1787781970.159182:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005909888 00000100:00100000:1.0:1787781970.159239:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:1.0:1787781970.159249:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f498b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:10316:x1874625005909888:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781970.159273:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781970.159293:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d961 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781970.159412:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787781970.159524:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454387 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d961 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.159537:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:1.0:1787781970.159540:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781970.159544:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d961 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.159557:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183fe00, rc 0) 00000100:00100000:1.0:1787781970.159894:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f498b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10316:x1874625005909888:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 644us (851us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787781970.159903:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00010000:00010000:1.0:1787781970.174721:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781970.175117:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781970.175272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005910016 00000100:00100000:1.0:1787781970.175282:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005910016 00000100:00100000:1.0:1787781970.175394:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:1.0:1787781970.175405:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10316:x1874625005910016:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:1.0:1787781970.175477:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175495:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175508:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175522:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175529:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175536:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175647:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175656:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175664:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781970.175705:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175727:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175733:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175739:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175744:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781970.175748:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175755:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175768:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:1.0:1787781970.175771:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781970.175776:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175782:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454395 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175816:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175823:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175829:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175843:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781970.175846:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175852:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.175860:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef448467b00) 00010000:00010000:1.0:1787781970.175863:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781970.175865:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.176068:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045439c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.176082:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.176088:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.176093:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.176097:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781970.176099:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.176105:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.176123:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:1.0:1787781970.176126:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781970.176129:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.176134:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781970.176271:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10316:x1874625005910016:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 867us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781970.176279:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:3.0:1787781970.178427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781970.178506:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005910272 00000100:00100000:2.0:1787781970.178514:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005910272 00000100:00100000:2.0:1787781970.178576:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1787781970.178587:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10316:x1874625005910272:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781970.178839:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:10316:x1874625005910272:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 253us (418us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787781970.178846:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:0.0:1787781970.274133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781970.274433:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005910528 00000100:00100000:2.0:1787781970.274445:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005910528 00000100:00100000:2.0:1787781970.274534:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1787781970.274558:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f4992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:10319:x1874625005910528:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781970.274591:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781970.274621:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c904543aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d968 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.274726:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.274744:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.274761:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.274845:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.274854:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.274862:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275039:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275048:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275056:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781970.275068:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787781970.275209:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275217:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275224:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275231:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781970.275237:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275268:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275284:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781970.275288:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781970.275293:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275301:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904543b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275348:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275355:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275361:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275366:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781970.275370:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275376:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275384:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef45088aa00) 00010000:00010000:2.0:1787781970.275387:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781970.275390:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275406:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275461:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c904543aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d968 expref: 34 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275477:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d968 expref: 33 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.275485:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:2.0:1787781970.275487:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781970.275489:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:2.0:1787781970.275584:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f4992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:10319:x1874625005910528:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1039us (1466us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787781970.275592:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1787781970.282096:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781970.282388:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005910656 00000100:00100000:3.0:1787781970.282402:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005910656 00000100:00100000:3.0:1787781970.282472:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1787781970.282496:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:10319:x1874625005910656:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1787781970.282601:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.282624:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.282639:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.282671:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.282678:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.282685:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.282692:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781970.282697:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.282723:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.282739:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:3.0:1787781970.282743:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781970.282748:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.282755:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781970.282887:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:10319:x1874625005910656:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 404us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781970.282897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1787781970.287997:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781970.288098:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005910912 00000100:00100000:2.0:1787781970.288111:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005910912 00000100:00100000:2.0:1787781970.288196:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:2.0:1787781970.288207:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:10319:x1874625005910912:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781970.288574:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:10319:x1874625005910912:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 367us (590us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787781970.288583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:0.0:1787781970.678367:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781970.678445:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005911168 00000100:00100000:2.0:1787781970.678459:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005911168 00000100:00100000:2.0:1787781970.678704:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:2.0:1787781970.678735:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:10350:x1874625005911168:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1787781970.678772:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781970.678846:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c904543d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d96f expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.679118:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.679137:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.679150:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781970.679164:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787781970.679369:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c904543d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d96f expref: 37 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.679393:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d96f expref: 36 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.679403:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:2.0:1787781970.679406:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781970.679411:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415200, rc 0) 00000100:00100000:2.0:1787781970.679736:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:10350:x1874625005911168:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1003us (1381us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787781970.679747:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:0.0:1787781970.684745:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781970.685022:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781970.685084:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005911552 00000100:00100000:3.0:1787781970.685098:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005911552 00000100:00100000:3.0:1787781970.685274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:3.0:1787781970.685288:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:10350:x1874625005911552:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:2.0:1787781970.685342:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005911296 00000100:00100000:2.0:1787781970.685348:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005911296 00000100:00100000:2.0:1787781970.685425:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:2.0:1787781970.685433:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:2349:x1874625005911296:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781970.685450:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781970.685483:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904543db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d96f expref: 37 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781970.685507:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:2.0:1787781970.685514:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781970.685595:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:2349:x1874625005911296:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 162us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781970.685604:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1787781970.685662:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:10350:x1874625005911552:12345-192.168.202.56@tcp:35:cat.0 Request processed in 376us (638us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787781970.685671:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:0.0:1787781970.732518:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781970.732990:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005911808 00000100:00100000:3.0:1787781970.733005:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005911808 00000100:00100000:3.0:1787781970.733089:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:3.0:1787781970.733099:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:10356:x1874625005911808:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:3.0:1787781970.733132:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781970.733160:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787781970.733192:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d945 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.733214:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:3.0:1787781970.733218:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781970.733232:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d976 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.733382:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.733396:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d968 expref: 36 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.733403:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.733437:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d968 expref: 36 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.733449:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d968 expref: 36 pid: 9081 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781970.733462:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023767296:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781970.733581:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4520990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781970.742611:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781970.742782:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023767296:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781970.742854:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781970.743231:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005911936 00000100:00100000:1.0:1787781970.743240:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005911936 00010000:00010000:1.0:1787781970.743289:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d968 expref: 37 pid: 9081 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781970.743343:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:1.0:1787781970.743354:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:2352:x1874625005911936:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781970.743373:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781970.743380:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d968 expref: 37 pid: 9081 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.743395:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d968 expref: 37 pid: 9081 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.743423:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904543bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d968 expref: 37 pid: 9081 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.743455:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:1.0:1787781970.743460:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.743468:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.743484:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.743507:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781970.743571:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:2352:x1874625005911936:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 219us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781970.743577:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00010000:00010000:3.0:1787781970.743929:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.743936:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781970.743955:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787781970.744180:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904543e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d976 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.744198:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d976 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781970.744206:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:3.0:1787781970.744209:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787781970.744212:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3400, rc 0) 00000100:00100000:3.0:1787781970.744249:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:10356:x1874625005911808:12345-192.168.202.56@tcp:101:dd.0 Request processed in 11152us (11764us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787781970.744259:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:0.0:1787781970.747043:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781970.747343:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005912192 00000100:00100000:1.0:1787781970.747357:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005912192 00000100:00100000:1.0:1787781970.747432:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:1.0:1787781970.747444:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:10356:x1874625005912192:12345-192.168.202.56@tcp:36:dd.0 00010000:00010000:1.0:1787781970.747828:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.747857:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.747870:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781970.747919:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787781970.747939:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001438231d reply state 00000000da6b8c26 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781970.747962:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787781970.748087:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+39:10356:x1874625005912192:12345-192.168.202.56@tcp:36:dd.0 Request processed in 635us (1049us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787781970.748096:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000020:00080000:1.0:1787781970.748101:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787781970.753019:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.753045:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.753053:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.753060:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781970.753067:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.753077:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.753099:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:1.0:1787781970.753103:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781970.753109:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781970.753116:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904543fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781970.884931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781970.885005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781970.885176:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005912448 00000100:00100000:2.0:1787781970.885191:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005912448 00000100:00100000:2.0:1787781970.885275:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:2.0:1787781970.885287:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2349:x1874625005912448:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781970.885399:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2349:x1874625005912448:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 113us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781970.885408:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:3.0:1787781970.886390:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005912320 00000100:00100000:3.0:1787781970.886399:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005912320 00000100:00100000:3.0:1787781970.886463:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 286 00000100:00100000:3.0:1787781970.886473:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005912320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781970.887336:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005912320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 859us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781970.887346:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 286 00000100:00100000:2.0:1787781970.899897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781970.902287:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005912576 00000100:00100000:1.0:1787781970.902340:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005912576 00000100:00100000:1.0:1787781970.902470:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:1.0:1787781970.902495:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005912576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781970.902631:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005912576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 150us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781970.902640:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00080000:3.0:1787781970.903573:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781971.025728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781971.025917:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005912704 00000100:00100000:1.0:1787781971.025930:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005912704 00000100:00100000:1.0:1787781971.026131:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:1.0:1787781971.026154:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:10370:x1874625005912704:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:1.0:1787781971.026186:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781971.026213:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d97d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.026323:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.026341:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.026356:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.026373:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.026381:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.026389:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787781971.026443:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787781971.027068:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.027086:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d976 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.027096:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.027365:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d976 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.027388:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d976 expref: 39 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781971.027404:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f9e7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023767424:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781971.027735:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4465d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787781971.032135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781971.032202:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005912960 00000100:00100000:3.0:1787781971.032214:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005912960 00000100:00100000:0.0:1787781971.032233:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f9e7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023767424:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781971.032291:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:3.0:1787781971.032314:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+40:5587:x1874625005912960:12345-192.168.202.56@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1787781971.032349:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781971.034776:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+41:5587:x1874625005912960:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 2457us (2639us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787781971.034822:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1787781971.038657:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.038762:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005913088 00000100:00100000:2.0:1787781971.038776:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005913088 00010000:00010000:2.0:1787781971.038935:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d976 expref: 41 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.039273:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:2.0:1787781971.039286:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+41:2351:x1874625005913088:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781971.039337:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781971.039346:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d976 expref: 41 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.039362:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d976 expref: 41 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.039391:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904543f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d976 expref: 41 pid: 5834 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.039411:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:2.0:1787781971.039418:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.039442:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.039451:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.039501:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781971.039586:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+40:2351:x1874625005913088:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 302us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.039595:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00010000:00010000:1.0:1787781971.040659:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040677:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781971.040742:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787781971.040748:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787781971.040849:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040886:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040899:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040905:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040912:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040918:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781971.040923:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040932:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040948:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:1.0:1787781971.040951:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781971.040956:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040974:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045440c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040991:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.040997:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.041010:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.041015:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183fa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781971.041018:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.041025:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.041034:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef448467b00) 00010000:00010000:1.0:1787781971.041037:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781971.041040:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.041046:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.041099:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d97d expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.041115:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d97d expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.041123:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:1.0:1787781971.041125:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781971.041128:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e600, rc 0) 00000100:00100000:1.0:1787781971.041217:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+39:10370:x1874625005912704:12345-192.168.202.56@tcp:101:stat.0 Request processed in 15074us (15499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.041236:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:2.0:1787781971.193651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781971.194212:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005913344 00000100:00100000:1.0:1787781971.194229:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005913344 00000100:00100000:1.0:1787781971.194343:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:1.0:1787781971.194356:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+39:10376:x1874625005913344:12345-192.168.202.56@tcp:36:truncate.0 00010000:00010000:1.0:1787781971.194442:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781971.194479:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c9045441a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d97d expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.194504:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:1.0:1787781971.194510:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781971.194985:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.195003:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.195013:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781971.195065:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787781971.195090:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026c11ba1 reply state 000000000528bb92 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781971.195100:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787781971.195227:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+41:10376:x1874625005913344:12345-192.168.202.56@tcp:36:truncate.0 Request processed in 873us (1585us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787781971.195235:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00000020:00080000:1.0:1787781971.195257:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787781971.199489:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781971.203934:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.203953:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.203980:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.203987:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781971.203994:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.204003:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.204023:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:2.0:1787781971.204027:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.204032:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.204040:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454421 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787781971.261743:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000004:00080000:3.0:1787781971.261763:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787781971.261809:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef473d590c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787781971.261814:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef473fd5f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef473d596c0 00000020:00080000:3.0:1787781971.261818:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef473fd5800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef4460d7800 00000001:00080000:3.0:1787781971.261843:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000001:00080000:3.0:1787781971.261888:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000100:00100000:2.0:1787781971.262460:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023767552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787781971.262545:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787781971.262683:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787781971.262841:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787781971.262861:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023767552 00000100:00100000:1.0:1787781971.262870:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023767552 00000100:00100000:1.0:1787781971.262936:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787781971.262947:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625023767552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787781971.262994:0:8308:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787781971.263035:0:8308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f6352, atime: 0x6a8f6352, ctime: 0x6a8f6352, blocks: 0xb 00010000:00010000:1.0:1787781971.263045:0:8308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.263065:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1787781971.263070:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781971.263078:0:8308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.263097:0:8308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.263109:0:8308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.263118:0:8308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.263140:0:8308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787781971.264432:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1874625023767552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1480us (1880us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787781971.264457:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787781971.264492:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781971.264501:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.264514:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787781971.264518:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.264530:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.264553:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.264562:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024383b92/0x3ad9816c90454428 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.264581:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781971.264583:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781971.264585:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787781971.268450:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef478a57840/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787781971.268471:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023767552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787781971.337668:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781971.338333:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005913472 00000100:00100000:0.0:1787781971.338347:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005913472 00000100:00100000:0.0:1787781971.338435:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1787781971.338447:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:10390:x1874625005913472:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:0.0:1787781971.338482:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781971.338509:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045442f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d984 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.338598:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.338616:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.338632:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.338651:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.338659:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.338666:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.340725:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.340750:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.340762:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781971.340854:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787781971.340861:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781971.340895:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.340911:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.340923:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.340929:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.340937:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.340944:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781971.340949:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.340957:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341104:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781971.341108:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.341114:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341121:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341339:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341347:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341353:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341359:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781971.341362:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341369:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341379:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef44a9a7e00) 00010000:00010000:2.0:1787781971.341381:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.341385:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341392:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c9045443d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341447:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045442f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d984 expref: 14 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341463:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d984 expref: 13 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.341484:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:2.0:1787781971.341487:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781971.341490:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414600, rc 0) 00000100:00100000:2.0:1787781971.341676:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:10390:x1874625005913472:12345-192.168.202.56@tcp:101:stat.0 Request processed in 3228us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.341686:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:1.0:1787781971.421573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.421698:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005913728 00000100:00100000:2.0:1787781971.421711:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005913728 00000100:00100000:2.0:1787781971.421830:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:2.0:1787781971.421843:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:10400:x1874625005913728:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781971.421873:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781971.421900:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045444b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d98b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781971.422468:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787781971.422685:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045444b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d98b expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.422704:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:2.0:1787781971.422708:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781971.422715:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045444b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d98b expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.422733:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415600, rc 0) 00000100:00100000:2.0:1787781971.422875:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:10400:x1874625005913728:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1033us (1317us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787781971.422895:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:3.0:1787781971.427020:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.427189:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005913984 00000100:00100000:2.0:1787781971.427204:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005913984 00000100:00100000:2.0:1787781971.427284:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:2.0:1787781971.427305:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:10400:x1874625005913984:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781971.427926:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:10400:x1874625005913984:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 629us (925us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787781971.427936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:3.0:1787781971.494060:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781971.494401:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005914240 00000100:00100000:1.0:1787781971.494415:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005914240 00000100:00100000:1.0:1787781971.494491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:1.0:1787781971.494503:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:10406:x1874625005914240:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1787781971.494561:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781971.494590:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454459 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d992 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.494751:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.494769:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d984 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.494780:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.494862:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d984 expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.494878:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d984 expref: 16 pid: 9081 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781971.494893:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f9e4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023767680:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781971.495277:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451517cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781971.498782:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781971.498978:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f9e4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023767680:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781971.499021:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.499109:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005914368 00000100:00100000:2.0:1787781971.499118:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005914368 00010000:00010000:2.0:1787781971.499185:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d984 expref: 17 pid: 9081 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.499230:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:2.0:1787781971.499241:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:2351:x1874625005914368:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781971.499261:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781971.499269:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d984 expref: 17 pid: 9081 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.499281:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d984 expref: 17 pid: 9081 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.499331:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d984 expref: 17 pid: 9081 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.499353:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:2.0:1787781971.499376:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.499388:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.499397:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.499427:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781971.499453:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.499499:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:2351:x1874625005914368:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 259us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.499508:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00010000:00010000:0.0:1787781971.499622:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781971.499650:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787781971.500008:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c90454459 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d992 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.500147:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d992 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.500157:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:0.0:1787781971.500159:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787781971.500162:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183ee00, rc 0) 00000100:00100000:0.0:1787781971.500265:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:10406:x1874625005914240:12345-192.168.202.56@tcp:101:bash.0 Request processed in 5763us (6218us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787781971.500274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:1.0:1787781971.503368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.503538:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005914624 00000100:00100000:2.0:1787781971.503551:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005914624 00000100:00100000:2.0:1787781971.503661:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:2.0:1787781971.503674:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:10406:x1874625005914624:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:2.0:1787781971.504110:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.504132:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.504160:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781971.504225:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787781971.504266:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecb38b89 reply state 0000000043f25a24 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.504277:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781971.504416:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:10406:x1874625005914624:12345-192.168.202.56@tcp:36:bash.0 Request processed in 743us (1062us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787781971.504424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000020:00080000:2.0:1787781971.504432:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787781971.506921:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.506943:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.506976:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.506983:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781971.506989:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.506999:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.507019:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:1.0:1787781971.507023:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781971.507028:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.507035:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045446e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781971.511251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.511703:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005914752 00000100:00100000:2.0:1787781971.511717:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005914752 00000100:00100000:2.0:1787781971.511887:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:2.0:1787781971.511902:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:10406:x1874625005914752:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781971.511935:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781971.511975:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d999 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.512113:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.512132:0:9081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d992 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.512142:0:9081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.512417:0:9081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d992 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.512434:0:9081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d992 expref: 19 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.512451:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023767808:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781971.512567:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4622f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787781971.515747:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781971.515838:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005914880 00000100:00100000:3.0:1787781971.515850:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005914880 00010000:00010000:3.0:1787781971.515918:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d992 expref: 20 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781971.515965:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:3.0:1787781971.515977:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:2352:x1874625005914880:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781971.515996:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781971.516020:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d992 expref: 20 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.516047:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d992 expref: 20 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.516079:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:3.0:1787781971.516087:0:8462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.516100:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.516111:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.516136:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781971.516143:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454460 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d992 expref: 20 pid: 5835 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781971.516179:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023767808:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781971.516199:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:2352:x1874625005914880:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 223us (465us total) trans 0 rc 0/0 00010000:00010000:2.0:1787781971.516208:0:9081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781971.516209:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00010000:00010000:2.0:1787781971.516222:0:9081:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.516228:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781971.516308:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787781971.516314:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781971.516339:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.516377:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d999 expref: 19 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.516394:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d999 expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.516402:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:2.0:1787781971.516406:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781971.516408:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415400, rc 0) 00000100:00100000:2.0:1787781971.516445:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:10406:x1874625005914752:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4548us (5210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.516453:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:3.0:1787781971.519864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.523740:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005915136 00000100:00100000:2.0:1787781971.523763:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005915136 00000100:00100000:2.0:1787781971.523874:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:2.0:1787781971.523887:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff2f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:10406:x1874625005915136:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:2.0:1787781971.524256:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff2f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:10406:x1874625005915136:12345-192.168.202.56@tcp:35:bash.0 Request processed in 362us (4399us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787781971.524266:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:3.0:1787781971.610662:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781971.610874:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005915392 00000100:00100000:1.0:1787781971.610887:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005915392 00000100:00100000:1.0:1787781971.611086:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:1.0:1787781971.611099:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:10416:x1874625005915392:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781971.611137:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781971.611232:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454483 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9a0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781971.611640:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787781971.611877:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454483 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9a0 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.611902:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:1.0:1787781971.611906:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781971.611913:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454483 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9a0 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.611929:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e400, rc 0) 00000100:00100000:1.0:1787781971.612441:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10416:x1874625005915392:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1342us (1791us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787781971.612452:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1787781971.617609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781971.617687:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005915520 00000100:00100000:1.0:1787781971.617701:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005915520 00000100:00100000:1.0:1787781971.617776:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:1.0:1787781971.617822:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446938f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10416:x1874625005915520:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:1.0:1787781971.617933:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.617953:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.617981:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.617999:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618007:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618042:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618506:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618519:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618528:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781971.618597:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618615:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618623:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618631:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618639:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781971.618644:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618654:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618671:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:1.0:1787781971.618681:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781971.618688:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618695:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618712:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618719:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618726:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618731:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781971.618734:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618740:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618749:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef448467b00) 00010000:00010000:1.0:1787781971.618751:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781971.618754:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618760:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618778:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618836:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618842:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618848:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781971.618851:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618858:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618866:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:1.0:1787781971.618868:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781971.618871:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.618877:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045449f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781971.621432:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446938f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10416:x1874625005915520:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 3627us (3821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.621450:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:3.0:1787781971.624460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781971.624579:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005915776 00000100:00100000:1.0:1787781971.624591:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005915776 00000100:00100000:1.0:1787781971.624698:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:1.0:1787781971.624710:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10416:x1874625005915776:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1787781971.626084:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:10416:x1874625005915776:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 1369us (1632us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787781971.626103:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1787781971.663220:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.663499:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005916032 00000100:00100000:2.0:1787781971.663511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005916032 00000100:00100000:2.0:1787781971.663591:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:2.0:1787781971.663604:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:10419:x1874625005916032:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781971.663639:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781971.663669:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904544a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9a7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.663768:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.663838:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.663851:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.663869:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.663876:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.663907:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.664655:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904544bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.664666:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904544bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.664676:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904544bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781971.664688:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787781971.665117:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665128:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665254:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665273:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781971.665278:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665287:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665314:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:3.0:1787781971.665317:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781971.665323:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665329:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904544ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665349:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665355:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665361:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665366:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781971.665369:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665375:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665394:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef45088aa00) 00010000:00010000:3.0:1787781971.665397:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781971.665400:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665406:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904544b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665471:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904544a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9a7 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665487:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904544bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9a7 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.665494:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:3.0:1787781971.665497:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781971.665499:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:3.0:1787781971.665598:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:10419:x1874625005916032:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1995us (2392us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787781971.665608:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:3.0:1787781971.670054:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781971.670170:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781971.670334:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005916288 00000100:00100000:0.0:1787781971.670347:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005916288 00000100:00100000:0.0:1787781971.670436:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:0.0:1787781971.670465:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:2349:x1874625005916288:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781971.670487:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781971.670520:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904544bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9a7 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.670545:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:0.0:1787781971.670552:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781971.670625:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:2349:x1874625005916288:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 162us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781971.670633:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1787781971.672699:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005916160 00000100:00100000:2.0:1787781971.672718:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005916160 00000100:00100000:1.0:1787781971.672945:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:1.0:1787781971.672971:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:10419:x1874625005916160:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:1.0:1787781971.673065:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.673086:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.673101:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.673312:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.673321:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.673329:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.673336:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781971.673340:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.673350:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.673365:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:1.0:1787781971.673369:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781971.673394:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.673402:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781971.673621:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:10419:x1874625005916160:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 663us (3578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.673630:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1787781971.676896:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.677018:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005916544 00000100:00100000:2.0:1787781971.677030:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005916544 00000100:00100000:2.0:1787781971.677096:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1787781971.677108:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:10419:x1874625005916544:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781971.677456:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:10419:x1874625005916544:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 348us (574us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787781971.677465:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1787781971.837209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781971.837398:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005916800 00000100:00100000:0.0:1787781971.837412:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005916800 00000100:00100000:0.0:1787781971.837537:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:0.0:1787781971.837549:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:10437:x1874625005916800:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1787781971.837583:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781971.837621:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904544d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9ae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.837784:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904544d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.837856:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904544d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.837870:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904544d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781971.837883:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787781971.838061:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c904544d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ae expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.838086:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904544d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ae expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781971.838095:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:0.0:1787781971.838098:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787781971.838102:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031800, rc 0) 00000100:00100000:0.0:1787781971.838180:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10437:x1874625005916800:12345-192.168.202.56@tcp:101:cat.0 Request processed in 633us (992us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787781971.838189:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:3.0:1787781971.872136:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781971.872284:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005916928 00000100:00100000:1.0:1787781971.872305:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005916928 00000100:00100000:1.0:1787781971.872386:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:1.0:1787781971.872398:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10438:x1874625005916928:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781971.872432:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781971.872461:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9b5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.872561:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904544ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.872579:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904544ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.872593:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904544ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781971.873026:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787781971.873033:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787781971.873121:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904544ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.873159:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9b5 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.873190:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904544ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9b5 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.873201:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:1.0:1787781971.873204:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787781971.873208:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183ea00, rc 0) 00000100:00100000:1.0:1787781971.873510:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10438:x1874625005916928:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1113us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.873519:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:3.0:1787781971.881510:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.881741:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005917312 00000100:00100000:2.0:1787781971.881754:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005917312 00000100:00100000:3.0:1787781971.882167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:3.0:1787781971.882205:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10438:x1874625005917312:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1787781971.882768:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10438:x1874625005917312:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 564us (1268us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787781971.882777:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:0.0:1787781971.886620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781971.886730:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005917440 00000100:00100000:3.0:1787781971.886743:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005917440 00000100:00100000:3.0:1787781971.886897:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:3.0:1787781971.886910:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10438:x1874625005917440:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:3.0:1787781971.886933:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787781971.886980:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045447c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d999 expref: 27 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.887011:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904544d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ae expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.887025:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454380 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d95a expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781971.887036:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7db200) 00010000:00010000:3.0:1787781971.887048:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781971.887122:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:10438:x1874625005917440:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 215us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781971.887131:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:0.0:1787781971.889890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781971.890015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005917568 00000100:00100000:1.0:1787781971.890026:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005917568 00000100:00100000:1.0:1787781971.890091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:1.0:1787781971.890103:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:10438:x1874625005917568:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:1.0:1787781971.890278:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.890309:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781971.890324:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787781971.891160:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787781971.891399:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787781971.891479:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787781971.891630:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:10438:x1874625005917568:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 1523us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781971.891653:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:0.0:1787781971.924234:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781971.924415:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005917696 00000100:00100000:2.0:1787781971.924429:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005917696 00000100:00100000:2.0:1787781971.924505:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:2.0:1787781971.924516:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:10440:x1874625005917696:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781971.924564:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781971.924592:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904544fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9bc expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.924680:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.924699:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.924714:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.924732:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.924740:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.924747:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925183:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925208:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925216:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781971.925261:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787781971.925272:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781971.925306:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925321:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925330:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925336:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925343:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925349:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781971.925353:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925361:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925375:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781971.925378:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.925383:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925389:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454501 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925404:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925421:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925428:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925433:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781971.925436:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925443:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925451:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef45088a600) 00010000:00010000:2.0:1787781971.925454:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781971.925457:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925463:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925504:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904544fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9bc expref: 26 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925520:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9bc expref: 25 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781971.925527:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef448467b00) 00010000:00010000:2.0:1787781971.925529:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781971.925538:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415400, rc 0) 00000100:00100000:2.0:1787781971.925619:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10440:x1874625005917696:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1103us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781971.925629:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:2.0:1787781972.158230:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023767936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781972.158362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781972.158625:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023767936 00000100:00100000:3.0:1787781972.158635:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023767936 00000100:00100000:3.0:1787781972.158714:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787781972.158725:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023767936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781972.158833:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781972.158900:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023767936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.158909:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787781972.159974:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023768064:0@lo:400:kworker.0 00000100:00100000:0.0:1787781972.160044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781972.160142:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023768064 00000100:00100000:2.0:1787781972.160149:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023768064 00000100:00100000:2.0:1787781972.160211:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787781972.160220:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023768064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781972.160280:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023768064:12345-0@lo:400:kworker.0 Request processed in 61us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.160297:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:1.0:1787781972.160824:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781972.160846:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023768192:0@lo:400:kworker.0 00000100:00100000:1.0:1787781972.160890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781972.160960:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023768192 00000100:00100000:2.0:1787781972.160965:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023768192 00000100:00100000:2.0:1787781972.161005:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787781972.161014:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023768192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781972.161054:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023768192:12345-0@lo:400:kworker.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.161060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787781972.161152:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023767936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781972.161464:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023768448:0@lo:400:kworker.0 00000100:00100000:2.0:1787781972.161498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781972.161608:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023768064:0@lo:400:kworker.0 00000100:00100000:0.0:1787781972.161647:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023768320:0@lo:400:kworker.0 00000100:00100000:0.0:1787781972.161676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781972.161719:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023768448 00000100:00100000:0.0:1787781972.161724:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023768448 00000100:00100000:0.0:1787781972.161764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023768320 00000100:00100000:0.0:1787781972.161768:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023768320 00000100:00100000:0.0:1787781972.161786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787781972.161812:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023768448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781972.161849:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023768448:12345-0@lo:400:kworker.0 Request processed in 39us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.161874:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787781972.161890:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787781972.161896:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023768320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781972.161931:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023768320:12345-0@lo:400:kworker.0 Request processed in 34us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.161937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787781972.161966:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023768320:0@lo:400:kworker.0 00000100:00100000:1.0:1787781972.162163:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023768192:0@lo:400:kworker.0 00000100:00080000:1.0:1787781972.162195:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781972.162476:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023768448:0@lo:400:kworker.0 00010000:00010000:1.0:1787781972.222441:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781972.286086:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781972.286099:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787781972.286167:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787781972.286180:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787781972.286387:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023768576:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787781972.286515:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4467506c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781972.300914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.301521:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023768576:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787781972.305883:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005917824 00000100:00100000:2.0:1787781972.305903:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005917824 00000100:00100000:2.0:1787781972.305987:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:2.0:1787781972.306009:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10451:x1874625005917824:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787781972.307081:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10451:x1874625005917824:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 Request processed in 126us (5232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.307094:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:1.0:1787781972.311029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781972.311151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005917952 00000100:00100000:0.0:1787781972.311165:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005917952 00000100:00100000:0.0:1787781972.311427:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:0.0:1787781972.311441:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10451:x1874625005917952:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787781972.311487:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787781972.311635:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10451:x1874625005917952:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 196us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.311644:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:3.0:1787781972.314909:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.314976:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005918080 00000100:00100000:3.0:1787781972.314989:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005918080 00000100:00100000:3.0:1787781972.315057:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:3.0:1787781972.315069:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10451:x1874625005918080:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787781972.315173:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315724:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315744:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315766:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315815:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315824:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315859:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315867:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315875:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781972.315924:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787781972.315929:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781972.315948:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315961:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315969:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315976:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.315983:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781972.315988:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316003:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316017:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:3.0:1787781972.316020:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781972.316026:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316033:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454516 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316049:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316056:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316062:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316068:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781972.316071:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316076:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316083:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9ef44a7db200) 00010000:00010000:3.0:1787781972.316085:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781972.316088:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316104:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c9045451d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316121:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316127:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316146:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316151:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781972.316155:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316161:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316170:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef448467b00) 00010000:00010000:3.0:1787781972.316172:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781972.316176:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.316182:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.316957:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10451:x1874625005918080:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 1884us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.316969:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:3.0:1787781972.319758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781972.319898:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005918336 00000100:00100000:0.0:1787781972.319911:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005918336 00000100:00100000:0.0:1787781972.319986:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:0.0:1787781972.319998:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:10451:x1874625005918336:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781972.320025:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781972.320050:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045452b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9c3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.320206:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.320709:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.320724:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781972.320741:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787781972.320903:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.320912:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.320919:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.320925:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781972.320930:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.320938:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.320954:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef448467b00) 00010000:00010000:0.0:1787781972.320957:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781972.321548:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.321561:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.321629:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045452b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9c3 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.321658:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:0.0:1787781972.321661:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787781972.321665:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045452b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9c3 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.321677:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030c00, rc 0) 00000100:00100000:0.0:1787781972.321778:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10451:x1874625005918336:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1780us (2033us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787781972.321816:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:1.0:1787781972.332770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.332961:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005918464 00000100:00100000:3.0:1787781972.332976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005918464 00000100:00100000:3.0:1787781972.333054:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:3.0:1787781972.333067:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10451:x1874625005918464:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787781972.333116:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787781972.333457:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10451:x1874625005918464:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 391us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.333467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:3.0:1787781972.336719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781972.336845:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005918720 00000100:00100000:1.0:1787781972.336857:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005918720 00000100:00100000:1.0:1787781972.336919:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:1.0:1787781972.336928:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10451:x1874625005918720:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781972.336955:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781972.336968:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787781972.337001:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c904544ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9b5 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.337024:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:1.0:1787781972.337030:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781972.337046:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454540 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9ca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787781972.338081:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787781972.340498:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.340539:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.340553:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.340646:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454540 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ca expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.340667:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ca expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.340676:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef448467f00) 00010000:00010000:1.0:1787781972.340679:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781972.340684:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e200, rc 0) 00000100:00100000:1.0:1787781972.340868:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10451:x1874625005918720:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3938us (4160us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787781972.340879:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:2.0:1787781972.358627:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781972.358717:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005918976 00000100:00100000:0.0:1787781972.358731:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005918976 00000100:00100000:0.0:1787781972.358830:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:0.0:1787781972.358842:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10451:x1874625005918976:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787781972.358922:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781972.358959:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ca expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.358984:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef448467f00) 00010000:00010000:0.0:1787781972.358997:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781972.359027:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359043:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359056:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359091:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359100:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359107:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359574:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359583:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359591:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359598:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781972.359603:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359613:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359624:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:0.0:1787781972.359627:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781972.359631:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359638:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454555 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359656:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359663:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359669:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359675:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781972.359678:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359685:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359693:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcdefc137 (ffff9ef44a9a7900) 00010000:00010000:0.0:1787781972.359696:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781972.359699:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.359706:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c9045455c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcdefc137 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.359837:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10451:x1874625005918976:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 995us (1223us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787781972.359846:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:0.0:1787781972.363209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781972.366135:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005919104 00000100:00100000:2.0:1787781972.366383:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005919104 00000100:00100000:2.0:1787781972.367423:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:2.0:1787781972.367441:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10451:x1874625005919104:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781972.367470:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781972.367501:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454563 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9d1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.367549:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.367566:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.367581:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.367720:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d1 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.367739:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d1 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.367761:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:2.0:1787781972.367765:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787781972.367770:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415600, rc 0) 00000100:00100000:2.0:1787781972.367877:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10451:x1874625005919104:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 442us (4690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.367885:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:1.0:1787781972.394688:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781972.398971:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005919360 00000100:00100000:1.0:1787781972.398993:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005919360 00000100:00100000:1.0:1787781972.399081:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:1.0:1787781972.399093:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10451:x1874625005919360:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787781972.399223:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.401443:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.401472:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787781972.401881:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787781972.401894:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340180103979ns, next at 341180101120ns, rc = 0 00000004:00010000:1.0:1787781972.402015:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0143be4 reply state 0000000077ce690f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781972.402026:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787781972.403641:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:10451:x1874625005919360:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 4533us (8950us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787781972.403657:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00010000:00010000:1.0:1787781972.408039:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.408063:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.408071:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.408079:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781972.408084:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.408092:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.408114:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:1.0:1787781972.408118:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787781972.408157:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.408164:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454571 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.409491:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.409553:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005919488 00000100:00100000:3.0:1787781972.409566:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005919488 00000100:00100000:3.0:1787781972.409634:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:3.0:1787781972.409646:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:10451:x1874625005919488:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781972.409680:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781972.409705:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9d8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.409784:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d8 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.409820:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d8 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.409845:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:3.0:1787781972.409848:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781972.409860:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3e00, rc 0) 00000100:00100000:3.0:1787781972.409939:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:10451:x1874625005919488:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 293us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.409949:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:1.0:1787781972.416350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781972.417650:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005919616 00000100:00100000:0.0:1787781972.417669:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005919616 00000100:00100000:0.0:1787781972.417780:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:0.0:1787781972.417813:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1874625005919616:12345-192.168.202.56@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787781972.417869:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:0.0:1787781972.417928:0:6695:0:(genops.c:1385:class_connect()) connect: client 3fd2e199-5730-414f-9ae9-e4e10b451cbf, cookie 0x3ad9816c9045457f 00002000:00100000:0.0:1787781972.417961:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3fd2e199-5730-414f-9ae9-e4e10b451cbf/ffff9ef448b36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787781972.417976:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787781972.419718:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787781972.419771:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ef448b30800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787781972.419895:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2348:x1874625005919616:12345-192.168.202.56@tcp:8:lhsmtool_posix.0 Request processed in 2080us (3557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.419907:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:2.0:1787781972.431556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781972.431659:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005919744 00000100:00100000:0.0:1787781972.431671:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005919744 00000100:00100000:0.0:1787781972.431765:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:0.0:1787781972.431779:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:0:x1874625005919744:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787781972.432429:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787781972.499599:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1787781972.499621:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000100:00100000:1.0:1787781972.499875:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:0:x1874625005919744:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 68091us (68325us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787781972.499890:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:3.0:1787781972.503093:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781972.503232:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005920000 00000100:00100000:1.0:1787781972.503334:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005920000 00000100:00100000:1.0:1787781972.503438:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1787781972.503450:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:10451:x1874625005920000:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787781972.503747:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10451:x1874625005920000:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 299us (668us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787781972.503756:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1787781972.506054:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.506201:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005920256 00000100:00100000:3.0:1787781972.506212:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005920256 00000100:00100000:3.0:1787781972.506438:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:3.0:1787781972.506450:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10451:x1874625005920256:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787781972.506590:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10451:x1874625005920256:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 142us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.506600:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:0.0:1787781972.508909:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.509074:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005920384 00000100:00100000:3.0:1787781972.509084:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005920384 00000100:00100000:3.0:1787781972.509208:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:3.0:1787781972.509221:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10451:x1874625005920384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781972.509258:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781972.509297:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454586 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.509387:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c9045458d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.509405:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c9045458d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.509441:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c9045458d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781972.509487:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781972.509511:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c9045458d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.509542:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454586 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9df expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.509563:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c9045458d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9df expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.509571:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:3.0:1787781972.509574:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787781972.509578:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3000, rc 0) 00000100:00100000:3.0:1787781972.509759:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:10451:x1874625005920384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 540us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.509767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:0.0:1787781972.512531:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781972.512755:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005920512 00000100:00100000:2.0:1787781972.512767:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005920512 00000100:00100000:2.0:1787781972.512860:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1787781972.512873:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2351:x1874625005920512:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781972.512894:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781972.512921:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9e6 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781972.512955:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6355, blocks: 0x1 00010000:00010000:2.0:1787781972.512984:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1787781972.512989:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781972.513002:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9e6 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.513025:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9e6 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.513062:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414a00, rc 0) 00000100:00100000:2.0:1787781972.513127:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005920512:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 257us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.513135:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:0.0:1787781972.515682:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781972.515907:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005920768 00000100:00100000:1.0:1787781972.515917:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005920768 00000100:00100000:1.0:1787781972.516017:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:1.0:1787781972.516029:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:10451:x1874625005920768:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787781972.516163:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:10451:x1874625005920768:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 135us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781972.516172:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:0.0:1787781972.518779:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.518906:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005920896 00000100:00100000:3.0:1787781972.518918:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005920896 00000100:00100000:3.0:1787781972.518983:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:3.0:1787781972.518993:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:10451:x1874625005920896:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781972.519015:0:8308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781972.519042:0:8308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9ed expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.519101:0:8308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9e6 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.519112:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781972.519117:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781972.519123:0:8308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 7 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.519173:0:8308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9e6 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.519190:0:8308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9e6 expref: 7 pid: 6695 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.519207:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023768704:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781972.519334:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef460ed2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787781972.521742:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023768704:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781972.521825:0:8308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 7 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.521852:0:8308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2600, rc 0) 00000100:00100000:3.0:1787781972.521910:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:10451:x1874625005920896:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2917us (3143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.521920:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:0.0:1787781972.524879:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781972.525048:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005921024 00000100:00100000:2.0:1787781972.525059:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005921024 00010000:00010000:2.0:1787781972.525113:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9e6 expref: 7 pid: 6695 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.525169:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:2.0:1787781972.525180:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2351:x1874625005921024:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781972.525199:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781972.525227:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9e6 expref: 7 pid: 6695 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.525256:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9e6 expref: 7 pid: 6695 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.525295:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f67c78f/0x3ad9816c90454594 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9e6 expref: 7 pid: 6695 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.525314:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781972.525319:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781972.525328:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 6 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.525358:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 6 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.525404:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 6 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.525421:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1874625023768832:192.168.202.56@tcp:105: 00000100:00100000:2.0:1787781972.525564:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef441377900 going to sleep for 11 seconds 00000100:00100000:2.0:1787781972.529417:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1874625023768832:192.168.202.56@tcp:105: 00010000:00010000:2.0:1787781972.529457:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781972.529522:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005921024:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 4341us (4656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.529535:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:0.0:1787781972.531350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.531500:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005921152 00000100:00100000:3.0:1787781972.531511:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005921152 00002000:00100000:3.0:1787781972.531572:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ef476aa12c0 x1874625005921152/t0(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:118/0 lens 504/0 e 0 to 0 dl 1787781983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787781972.531585:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef476aa12c0 with x1874625005921152 ext(0->8) 00002000:00010000:3.0:1787781972.531591:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef476aa12c0 00000100:00100000:3.0:1787781972.531629:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:3.0:1787781972.531640:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005921152:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787781972.532706:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005921152:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 1060us (1358us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787781972.532719:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00002000:00100000:3.0:1787781972.532730:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ef476aa12c0 x1874625005921152/t4294967302(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:118/0 lens 504/448 e 0 to 0 dl 1787781983 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787781972.532741:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef476aa12c0 with x1874625005921152 ext(0->8) 00002000:00010000:3.0:1787781972.532747:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef476aa12c0 00000100:00100000:0.0:1787781972.546441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.546649:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005921280 00000100:00100000:3.0:1787781972.546665:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005921280 00000100:00100000:3.0:1787781972.546731:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:3.0:1787781972.546743:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:10451:x1874625005921280:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787781972.654819:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:10451:x1874625005921280:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 108038us (108353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.654835:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000001:00080000:3.0:1787781972.654882:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:3.0:1787781972.654911:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787781972.654920:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787781972.654957:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1787781972.655119:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787781972.655131:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787781972.655137:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787781972.655152:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023768960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787781972.655206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781972.655262:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023768960 00000100:00100000:3.0:1787781972.655269:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023768960 00000100:00100000:3.0:1787781972.655396:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787781972.655405:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023768960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787781972.655564:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787781972.655567:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787781973 00002000:00010000:3.0:1787781972.655570:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787781972.655572:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787781973 -> 1787781973 00002000:00010000:3.0:1787781972.655575:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787781972.655612:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625023768960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (406us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787781972.655619:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1787781972.655662:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef478f9c000/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787781972.655668:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023768960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787781972.659881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781972.660036:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005921408 00000100:00100000:1.0:1787781972.660049:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005921408 00000100:00100000:1.0:1787781972.660135:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:1.0:1787781972.660147:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2352:x1874625005921408:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787781972.670000:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781972.670031:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023769088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781972.670134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781972.670219:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023769088 00000100:00100000:3.0:1787781972.670237:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023769088 00000100:00080000:0.0:1787781972.670307:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781972.670332:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787781972.670344:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874625023769088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781972.670383:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781972.670490:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874625023769088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.670513:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787781972.670929:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023769088:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787781972.742583:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787781972.742941:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787781972.743191:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005921408:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 83038us (83316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781972.743204:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:2.0:1787781972.748420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781972.748511:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005921664 00000100:00100000:0.0:1787781972.748524:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005921664 00000100:00100000:0.0:1787781972.748613:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:0.0:1787781972.748626:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:10451:x1874625005921664:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787781972.748967:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781972.749070:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c9045458d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9df expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.749092:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:0.0:1787781972.749098:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781972.749142:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.749159:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.749170:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781972.749521:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8d79287 reply state 000000002f977c9c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.749533:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781972.749663:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:10451:x1874625005921664:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1038us (1258us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787781972.749672:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 81 00010000:00010000:1.0:1787781972.756536:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.756559:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.756567:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.756574:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781972.756580:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.756589:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.756610:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:1.0:1787781972.756614:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781972.756619:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.756625:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.757073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.757236:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005921792 00000100:00100000:3.0:1787781972.757259:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005921792 00000100:00100000:3.0:1787781972.757340:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:3.0:1787781972.757353:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005921792:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787781972.757682:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787781972.757686:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787781973 -> 1787781972 00002000:00010000:3.0:1787781972.757689:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787781970 00002000:00010000:3.0:1787781972.757691:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787781973 -> 1787781972 00002000:00010000:3.0:1787781972.757693:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787781972.758052:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005921792:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 700us (984us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787781972.758063:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:3.0:1787781972.761633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781972.761898:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005922048 00000100:00100000:1.0:1787781972.761911:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005922048 00000100:00100000:1.0:1787781972.762390:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:1.0:1787781972.762404:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:10451:x1874625005922048:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787781972.763416:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.763444:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d1 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.763455:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.763504:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d1 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.763537:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d1 expref: 13 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.763555:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023769216:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781972.763703:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44672c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781972.771178:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023769216:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787781972.771223:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.774465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781972.780385:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005922176 00000100:00100000:2.0:1787781972.780405:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005922176 00010000:00010000:2.0:1787781972.780463:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d1 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.780572:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:2.0:1787781972.780585:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:2351:x1874625005922176:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781972.780605:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781972.780614:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d1 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.780631:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d1 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.780659:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045456a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d1 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.780678:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:2.0:1787781972.780684:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.780709:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.780729:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.780768:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781972.780872:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:2351:x1874625005922176:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 288us (6420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.780881:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00010000:00010000:0.0:1787781972.784103:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.784125:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.784166:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.784175:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.784183:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.784190:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781972.784195:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.784204:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.784225:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:0.0:1787781972.784229:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787781972.784234:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781972.784254:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904545a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781972.784375:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:10451:x1874625005922048:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 21969us (22751us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787781972.784404:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:0.0:1787781972.792226:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.797119:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005922304 00000100:00100000:3.0:1787781972.797140:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005922304 00000100:00100000:3.0:1787781972.797227:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:3.0:1787781972.798210:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005922304:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787781972.799122:0:8308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.799157:0:8308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 7 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.799168:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781972.799190:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781972.799196:0:8308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.799381:0:8308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 7 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.799402:0:8308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 7 pid: 8308 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.799421:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023769344:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781972.800379:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef441377b40 going to sleep for 11 seconds 00000040:00080000:2.0:1787781972.806736:0:12009:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781972.806751:0:12009:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781972.808318:0:12009:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787781972.808333:0:12009:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787781972.814292:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.814474:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023769344:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781972.814516:0:8308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.814576:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005922432 00000100:00100000:2.0:1787781972.814585:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005922432 00010000:00010000:2.0:1787781972.814636:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 8 pid: 8308 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.814715:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:2.0:1787781972.814727:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005922432:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781972.814748:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781972.815157:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 8 pid: 8308 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.815174:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 8 pid: 8308 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.815231:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3721e2c/0x3ad9816c9045459b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9ed expref: 8 pid: 8308 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.815262:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781972.815268:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781972.815275:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.815296:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.815369:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781972.815435:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2351:x1874625005922432:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 710us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781972.815445:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00010000:00010000:3.0:1787781972.816166:0:8308:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.816180:0:8308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.816217:0:8308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.816225:0:8308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.816317:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.816326:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781972.816330:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.816340:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.816358:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.816365:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f62a3844/0x3ad9816c904545b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.816485:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005922304:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 19245us (24271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.816495:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:0.0:1787781972.820679:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781972.826722:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005922688 00000100:00100000:2.0:1787781972.826744:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005922688 00000100:00100000:2.0:1787781972.827058:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:2.0:1787781972.827070:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:10451:x1874625005922688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787781972.827184:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.827225:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.827246:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.828055:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.828074:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d8 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.828085:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.828130:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d8 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.828146:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d8 expref: 13 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781972.828163:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023769472:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781972.828328:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44672cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787781972.849157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.850947:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005922816 00000100:00100000:3.0:1787781972.850964:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005922816 00010000:00010000:3.0:1787781972.851027:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d8 expref: 14 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.851098:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:3.0:1787781972.851130:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:2352:x1874625005922816:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781972.851147:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781972.851155:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d8 expref: 14 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.851168:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d8 expref: 14 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.851191:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:3.0:1787781972.851197:0:8462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.851206:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.851214:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.851235:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781972.851306:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:2352:x1874625005922816:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 182us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781972.851316:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00010000:00010000:1.0:1787781972.851815:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9d8 expref: 13 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781972.851833:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023769472:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787781972.851854:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.851864:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.851870:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781972.852067:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787781972.852222:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787781972.852267:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787781972.852365:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f9e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023769600:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787781972.852428:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781972.853935:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448b67600 going to sleep for 11 seconds 00000100:00100000:0.0:1787781972.855133:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023769600 00000100:00100000:0.0:1787781972.855144:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023769600 00000100:00100000:0.0:1787781972.855205:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787781972.855215:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1874625023769600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787781972.855345:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1874625023769600:12345-0@lo:1000:mdt00_002.0 Request processed in 131us (2917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781972.855356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787781972.855455:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787781972.855461:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef478f9c000, transno 4294967303 00000100:00100000:3.0:1787781972.855481:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f9e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023769600:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787781972.856060:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787781972.856143:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023769728:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787781972.856190:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781972.856233:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4412ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781972.856270:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023769728 00000100:00100000:2.0:1787781972.856292:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023769728 00000100:00100000:2.0:1787781972.856361:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787781972.856372:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1874625023769728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787781972.860028:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874625023769728:12345-0@lo:1000:mdt00_002.0 Request processed in 3644us (3823us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787781972.860048:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787781972.860139:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023769728:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787781972.860192:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860203:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860211:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860218:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781972.860223:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860231:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860247:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:3.0:1787781972.860250:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781972.860255:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860261:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904545be lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860313:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860320:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860326:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860349:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781972.860352:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860359:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860367:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef448467b00) 00010000:00010000:3.0:1787781972.860370:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781972.860373:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860380:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c904544f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860402:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860428:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9bc expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860444:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860481:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9bc expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.860498:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9bc expref: 16 pid: 9081 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781972.860522:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023769856:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781972.860615:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781972.866964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.867200:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023769856:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781972.867258:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781972.868233:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005922944 00000100:00100000:1.0:1787781972.868986:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005922944 00010000:00010000:1.0:1787781972.869052:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9bc expref: 17 pid: 9081 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781972.869127:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:1.0:1787781972.869138:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:2352:x1874625005922944:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781972.869160:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781972.869169:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9bc expref: 17 pid: 9081 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.869184:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9bc expref: 17 pid: 9081 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.869215:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045450f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9bc expref: 17 pid: 9081 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.869252:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef448467b00) 00010000:00010000:1.0:1787781972.869259:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.869272:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.869289:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781972.869324:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781972.869552:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869562:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869578:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869586:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869594:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869601:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781972.869606:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869615:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869626:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef448467b00) 00010000:00010000:3.0:1787781972.869638:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781972.869643:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869649:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869662:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869668:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869674:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869679:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781972.869681:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869686:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869695:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef448467b00) 00010000:00010000:3.0:1787781972.869697:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787781972.869700:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.869706:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904545b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781972.873616:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:2352:x1874625005922944:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 4460us (6651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781972.873637:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:3.0:1787781972.873991:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:10451:x1874625005922688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 46919us (53323us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1787781972.874026:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 83 00000020:00080000:3.0:1787781972.874032:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787781972.874223:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781972.874229:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787781972.878206:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787781972.878224:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787781972.881381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781972.881534:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005923200 00000100:00100000:3.0:1787781972.881548:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005923200 00000100:00100000:3.0:1787781972.881623:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:3.0:1787781972.881635:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:10451:x1874625005923200:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787781972.882657:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787781972.882781:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787781972.882872:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.882893:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.882908:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.882918:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.882925:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.882931:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781972.882962:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787781972.883092:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:10451:x1874625005923200:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1456us (1725us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787781972.883103:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000020:00080000:3.0:1787781972.883110:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787781972.883982:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787781972.883995:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.884017:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787781972.884022:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.884032:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.884051:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ef44a7dbb00) 00010000:00010000:2.0:1787781972.884055:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787781972.884062:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.884068:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781972.884094:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781972.884096:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781972.884098:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781973.246379:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781974.279916:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781974.830336:0:12061:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781974.830346:0:12061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787781974.830454:0:12061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787781974.830459:0:12061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787781974.922199:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781974.922211:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787781974.922254:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787781974.922261:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787781975.029947:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.030029:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005923456 00000100:00100000:3.0:1787781975.030041:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005923456 00000100:00100000:3.0:1787781975.030135:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:3.0:1787781975.030148:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:10470:x1874625005923456:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781975.030183:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781975.030211:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9f4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.030562:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2e00/0x3ad9816c904545da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.030579:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2e00/0x3ad9816c904545da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.030593:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2e00/0x3ad9816c904545da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781975.030615:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787781975.030932:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c904545d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9f4 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.030951:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2e00/0x3ad9816c904545da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9f4 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.030960:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:3.0:1787781975.030963:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787781975.030968:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2e00, rc 0) 00000100:00100000:3.0:1787781975.031051:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:10470:x1874625005923456:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 907us (1115us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787781975.031061:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00080000:1.0:1787781975.036142:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781975.038439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.038526:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005923584 00000100:00100000:3.0:1787781975.038539:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005923584 00000100:00100000:3.0:1787781975.038615:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:3.0:1787781975.038626:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:10470:x1874625005923584:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:3.0:1787781975.038746:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.038768:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.038781:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.038843:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.038870:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.038878:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039243:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039253:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039272:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781975.039325:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039341:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039349:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039357:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039364:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781975.039369:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039378:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039401:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:3.0:1787781975.039404:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781975.039409:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039416:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c904545e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039430:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039436:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039441:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039446:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781975.039449:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039455:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039463:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef44a7db200) 00010000:00010000:3.0:1787781975.039465:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781975.039468:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039475:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c904545ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039501:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039508:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039514:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039520:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781975.039523:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039529:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039536:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a7dbe00) 00010000:00010000:3.0:1787781975.039539:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781975.039542:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.039548:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904545f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781975.039648:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:10470:x1874625005923584:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 1021us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781975.039658:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:3.0:1787781975.131010:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.131380:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005923840 00000100:00100000:0.0:1787781975.131393:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005923840 00000100:00100000:0.0:1787781975.131516:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:0.0:1787781975.131529:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:10473:x1874625005923840:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787781975.131571:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781975.131599:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140d9fb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.131707:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.131723:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.131764:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.131783:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.131822:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.131828:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132189:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132199:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132207:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781975.132220:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787781975.132351:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132359:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132366:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132372:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781975.132384:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132393:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132408:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:0.0:1787781975.132412:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781975.132417:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132425:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132440:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132446:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132452:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132457:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781975.132460:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132466:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132474:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781975.132476:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781975.132486:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132492:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045460b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132542:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904545fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9fb expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132557:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9fb expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.132565:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:0.0:1787781975.132567:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781975.132570:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031600, rc 0) 00000100:00100000:0.0:1787781975.133072:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:10473:x1874625005923840:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1543us (2073us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787781975.133083:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:1.0:1787781975.136249:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.136881:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005923968 00000100:00100000:3.0:1787781975.136894:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005923968 00000100:00100000:3.0:1787781975.137009:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:3.0:1787781975.137020:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:10473:x1874625005923968:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1787781975.137110:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.137128:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.137140:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.137170:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.137177:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.137185:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.137191:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781975.137196:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.137203:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.137215:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:3.0:1787781975.137218:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781975.137222:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.137238:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781975.137335:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f9e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:10473:x1874625005923968:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 317us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781975.137342:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:2.0:1787781975.144128:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.144341:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005924224 00000100:00100000:3.0:1787781975.144353:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005924224 00000100:00100000:3.0:1787781975.144425:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:3.0:1787781975.144437:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff2e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:10473:x1874625005924224:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781975.146000:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff2e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:10473:x1874625005924224:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 1553us (1875us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787781975.146016:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:1.0:1787781975.205767:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.206434:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005924480 00000100:00100000:3.0:1787781975.206449:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005924480 00000100:00100000:3.0:1787781975.206531:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:3.0:1787781975.206544:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:9993:x1874625005924480:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1787781975.206578:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781975.206606:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454627 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.206743:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.206760:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9fb expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.206771:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.206868:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9fb expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.206884:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9fb expref: 23 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781975.206900:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023769984:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781975.207029:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef441370b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781975.211500:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.211635:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023769984:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781975.211675:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781975.211691:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005924608 00000100:00100000:2.0:1787781975.211700:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005924608 00010000:00010000:2.0:1787781975.211748:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9fb expref: 24 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781975.211837:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:2.0:1787781975.211847:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:2352:x1874625005924608:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781975.211876:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781975.211884:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9fb expref: 24 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.211898:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9fb expref: 24 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.211924:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454612 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9fb expref: 24 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.211943:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:2.0:1787781975.211948:0:8462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.211958:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.211966:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.211994:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781975.212044:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a79e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:2352:x1874625005924608:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 199us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781975.212052:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00010000:00010000:3.0:1787781975.212067:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.212077:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781975.212099:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787781975.212409:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454627 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da02 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.212425:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da02 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.212434:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:3.0:1787781975.212437:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787781975.212446:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2400, rc 0) 00000100:00100000:3.0:1787781975.212486:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:9993:x1874625005924480:12345-192.168.202.56@tcp:101:bash.0 Request processed in 5945us (6736us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787781975.212494:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:1.0:1787781975.216649:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.216848:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005924864 00000100:00100000:0.0:1787781975.216861:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005924864 00000100:00100000:0.0:1787781975.216937:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 89 00000100:00100000:0.0:1787781975.216950:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:9993:x1874625005924864:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:0.0:1787781975.217356:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.217378:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.217392:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781975.217474:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787781975.217502:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a0a2370 reply state 00000000fb531dfe transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781975.217512:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787781975.217563:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787781975.217699:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:9993:x1874625005924864:12345-192.168.202.56@tcp:36:bash.0 Request processed in 751us (1065us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787781975.217708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 89 00000020:00080000:0.0:1787781975.217714:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787781975.221109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781975.221203:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005924992 00000100:00100000:2.0:1787781975.221225:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005924992 00000100:00100000:2.0:1787781975.221303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 90 00000100:00100000:2.0:1787781975.221315:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:9993:x1874625005924992:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781975.221370:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781975.221398:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454643 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da09 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.221479:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da09 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.221496:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da09 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.221520:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:2.0:1787781975.221524:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781975.221529:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414400, rc 0) 00000100:00100000:2.0:1787781975.221672:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:9993:x1874625005924992:12345-192.168.202.56@tcp:101:bash.0 Request processed in 357us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781975.221680:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 90 00010000:00010000:1.0:1787781975.222647:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.222662:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.222670:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.222677:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781975.222681:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.222689:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.222706:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:1.0:1787781975.222710:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781975.222715:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.222722:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c9045463c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781975.224575:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.224732:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005925120 00000100:00100000:3.0:1787781975.224744:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005925120 00000100:00100000:3.0:1787781975.224862:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:3.0:1787781975.224876:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:9993:x1874625005925120:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1787781975.224899:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781975.224923:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da10 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787781975.224956:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f6354, atime: 0x6a8f6352, ctime: 0x6a8f6354, blocks: 0xb 00010000:00010000:3.0:1787781975.224982:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1787781975.224988:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781975.224998:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da10 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.225020:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da10 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.225035:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3e00, rc 0) 00000100:00100000:3.0:1787781975.225121:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:9993:x1874625005925120:12345-192.168.202.56@tcp:101:bash.0 Request processed in 248us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781975.225129:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00080000:1.0:1787781975.225633:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781975.228334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781975.228491:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005925248 00000100:00100000:1.0:1787781975.228503:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005925248 00002000:00010000:1.0:1787781975.228557:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787781975.228562:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef450d6e580 with x1874625005925248 ext(0->18446744073709551615) 00002000:00010000:1.0:1787781975.228577:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef450d6e580. 00000100:00100000:1.0:1787781975.228752:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:1.0:1787781975.228765:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2350:x1874625005925248:12345-192.168.202.56@tcp:10:bash.0 00002000:00010000:1.0:1787781975.229426:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787781975.229431:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787781972 -> 1787781976 00002000:00010000:1.0:1787781975.229434:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787781970 -> 1787781970 00002000:00010000:1.0:1787781975.229437:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787781972 -> 1787781976 00002000:00010000:1.0:1787781975.229439:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787781975.229562:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2350:x1874625005925248:12345-192.168.202.56@tcp:10:bash.0 Request processed in 798us (1241us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787781975.229573:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00002000:00010000:1.0:1787781975.229578:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787781975.229581:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef450d6e580 with x1874625005925248 ext(0->18446744073709551615) 00002000:00010000:1.0:1787781975.229595:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef450d6e580. 00010000:00010000:2.0:1787781975.297516:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787781975.314118:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1787781975.338101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.338320:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005925376 00000100:00100000:0.0:1787781975.338335:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005925376 00000100:00100000:0.0:1787781975.338410:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:0.0:1787781975.338423:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10487:x1874625005925376:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:0.0:1787781975.338528:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.338552:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.338566:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.338583:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.338591:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.338620:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339037:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339048:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339056:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781975.339107:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339120:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339127:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339135:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339142:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781975.339147:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339156:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339170:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:0.0:1787781975.339181:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781975.339188:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339195:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339617:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339625:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339631:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339637:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781975.339640:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339646:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339654:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781975.339657:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781975.339660:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339666:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339683:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339699:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339704:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339709:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781975.339712:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339717:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339724:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:0.0:1787781975.339726:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781975.339730:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.339735:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045465f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781975.340058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10487:x1874625005925376:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 1633us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781975.340070:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:2.0:1787781975.407875:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781975.409293:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005925632 00000100:00100000:1.0:1787781975.409312:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005925632 00000100:00100000:0.0:1787781975.411451:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00100000:0.0:1787781975.411468:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:10490:x1874625005925632:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787781975.411499:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781975.411528:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454666 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da17 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.411625:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.411854:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.411869:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.411887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.411894:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.411901:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.412907:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045467b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.412923:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045467b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.412933:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045467b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781975.412946:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787781975.413389:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413400:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413408:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413425:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781975.413431:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413441:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413457:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:0.0:1787781975.413461:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781975.413466:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413474:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045466d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413492:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413499:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413505:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413511:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781975.413514:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413521:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413541:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781975.413543:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781975.413547:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413554:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.413615:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454666 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da17 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.414592:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045467b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da17 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.414606:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:0.0:1787781975.414609:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787781975.414612:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030e00, rc 0) 00000100:00100000:0.0:1787781975.415197:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:10490:x1874625005925632:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3729us (7334us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787781975.415270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00100000:0.0:1787781975.425441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.425572:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005925760 00000100:00100000:3.0:1787781975.425584:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005925760 00000100:00100000:3.0:1787781975.425778:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 93 00000100:00100000:3.0:1787781975.425825:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:10490:x1874625005925760:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1787781975.425913:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.425934:0:9081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da02 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.425946:0:9081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.425995:0:9081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da02 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.426011:0:9081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da02 expref: 29 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781975.426029:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023770112:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781975.429173:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4459340c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781975.436365:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.437639:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005926016 00000100:00100000:0.0:1787781975.437654:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005926016 00000100:00100000:0.0:1787781975.437737:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:0.0:1787781975.437748:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:5587:x1874625005926016:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787781975.438418:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:5587:x1874625005926016:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 441us (1839us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787781975.438456:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:3.0:1787781975.439735:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023770112:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781975.439773:0:9081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781975.445489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781975.445820:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005926144 00000100:00100000:1.0:1787781975.445831:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005926144 00010000:00010000:1.0:1787781975.445878:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da02 expref: 31 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781975.445917:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:1.0:1787781975.445925:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:2351:x1874625005926144:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781975.445957:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781975.445971:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da02 expref: 31 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.445992:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da02 expref: 31 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.446021:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c9045462e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da02 expref: 31 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.446041:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:1.0:1787781975.446047:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.446058:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.446067:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.446102:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781975.446174:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:2351:x1874625005926144:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 249us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781975.446181:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00010000:00010000:0.0:1787781975.446245:0:9081:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.446255:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.446304:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.446310:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.446315:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.446319:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781975.446322:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.446329:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.446335:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:0.0:1787781975.446337:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787781975.446340:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.446344:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3a00/0x3ad9816c90454689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781975.446386:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:10490:x1874625005925760:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 20600us (20963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781975.446393:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 93 00000100:00100000:1.0:1787781975.450246:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781975.450354:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005926400 00000100:00100000:2.0:1787781975.450366:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005926400 00000100:00100000:2.0:1787781975.450440:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:2.0:1787781975.450452:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:10490:x1874625005926400:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781975.450817:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10490:x1874625005926400:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 366us (587us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787781975.450825:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:3.0:1787781975.557938:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.558348:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005926656 00000100:00100000:0.0:1787781975.558361:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005926656 00000100:00100000:0.0:1787781975.558439:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 94 00000100:00100000:0.0:1787781975.558452:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:10500:x1874625005926656:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1787781975.558485:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781975.558512:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454690 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.558607:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.558626:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.558639:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.558657:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.558665:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.558672:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559644:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c904546a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559657:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c904546a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559674:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c904546a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781975.559688:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787781975.559829:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559838:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559845:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559853:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781975.559857:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559866:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559881:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:1.0:1787781975.559885:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781975.559890:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559897:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559912:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559918:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559931:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559936:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781975.559939:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559946:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.559953:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef44a9a7a00) 00010000:00010000:1.0:1787781975.559956:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781975.560342:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.560353:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045469e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.560419:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c90454690 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da1e expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.560436:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c904546a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da1e expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.560444:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:1.0:1787781975.560447:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781975.560449:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e200, rc 0) 00000100:00100000:1.0:1787781975.560543:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:10500:x1874625005926656:12345-192.168.202.56@tcp:101:cat.0 Request processed in 2093us (2622us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787781975.560564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 94 00000100:00100000:2.0:1787781975.565631:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.565723:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005926912 00000100:00100000:3.0:1787781975.565735:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005926912 00000100:00100000:3.0:1787781975.566037:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:3.0:1787781975.566053:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:10500:x1874625005926912:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:3.0:1787781975.566828:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:10500:x1874625005926912:12345-192.168.202.56@tcp:35:cat.0 Request processed in 775us (1208us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787781975.566839:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:0.0:1787781975.581658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781975.581842:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005927168 00000100:00100000:2.0:1787781975.581855:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005927168 00000100:00100000:2.0:1787781975.581920:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00100000:2.0:1787781975.581932:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:10502:x1874625005927168:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:2.0:1787781975.582197:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787781975.582232:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c904546a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da1e expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582275:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c9045467b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da17 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582290:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da09 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582301:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef44a9a7500) 00010000:00010000:2.0:1787781975.582313:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781975.582340:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582356:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582367:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582408:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582416:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582423:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582780:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582972:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.582981:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787781975.583647:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787781975.583899:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343362108923ns, next at 344362104345ns, rc = 0 00010000:00010000:2.0:1787781975.583984:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.583997:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584006:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584014:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584034:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584041:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584139:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787781975.584164:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584171:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584178:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584185:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781975.584191:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584199:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584213:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef45088a300) 00010000:00010000:2.0:1787781975.584216:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787781975.584222:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584229:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584250:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584274:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584280:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584286:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781975.584290:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584297:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584306:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781975.584309:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781975.584312:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.584319:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781975.584331:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076f3a5a3 reply state 00000000e10f84e1 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781975.584341:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781975.584461:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:10502:x1874625005927168:12345-192.168.202.56@tcp:36:rm.0 Request processed in 2526us (2815us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787781975.584472:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 95 00010000:00010000:3.0:1787781975.590277:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781975.590300:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.590315:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781975.590320:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.590332:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.590355:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ef45088a300) 00010000:00010000:3.0:1787781975.590359:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787781975.590365:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.590373:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904546c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.590401:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781975.590403:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781975.590405:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781975.594054:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.594079:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.594089:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.594096:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781975.594170:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.594181:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.594202:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef45088a800) 00010000:00010000:1.0:1787781975.594206:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781975.594212:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.594219:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904546ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781975.623077:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781975.623291:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005927424 00000100:00100000:2.0:1787781975.623305:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005927424 00000100:00100000:2.0:1787781975.623459:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 96 00000100:00100000:2.0:1787781975.623473:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:10508:x1874625005927424:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781975.623508:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781975.623536:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da25 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.623706:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.623725:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.623740:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.623759:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.623767:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.623774:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787781975.624528:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787781975.624728:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624741:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624750:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624838:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624846:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624853:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624860:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781975.624865:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624874:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624889:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781975.624893:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781975.624898:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624904:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904546d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781975.624919:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f16497c5 reply state 000000001f7710a8 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781975.624929:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787781975.624967:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904546cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da25 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.624997:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da25 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.625005:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:2.0:1787781975.625008:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781975.625010:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415400, rc 0) 00000100:00100000:2.0:1787781975.625097:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:10508:x1874625005927424:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1627us (2034us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787781975.625106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 96 00010000:00010000:1.0:1787781975.630572:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.630593:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.630623:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.630631:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781975.630636:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.630645:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.630664:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef45088a900) 00010000:00010000:1.0:1787781975.630668:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781975.630673:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.630679:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904546dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781975.631968:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.633002:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005927552 00000100:00100000:0.0:1787781975.633019:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005927552 00000100:00100000:0.0:1787781975.633116:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:0.0:1787781975.633128:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2349:x1874625005927552:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1787781975.633153:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781975.633179:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da2c expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787781975.633214:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787781975.633238:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1787781975.633244:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781975.633266:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da2c expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.633291:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da2c expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.633308:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030a00, rc 0) 00000100:00100000:0.0:1787781975.633389:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2349:x1874625005927552:12345-192.168.202.56@tcp:101:bash.0 Request processed in 263us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781975.633396:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00080000:1.0:1787781975.633482:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781975.644767:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.645023:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005927680 00000100:00100000:3.0:1787781975.645036:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005927680 00000100:00100000:3.0:1787781975.645125:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:3.0:1787781975.645137:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:10508:x1874625005927680:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1787781975.645186:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781975.645214:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da33 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.645251:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da2c expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.645273:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781975.645279:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781975.645284:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.645332:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da2c expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.645348:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da2c expref: 7 pid: 6697 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781975.645364:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874625023770240:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781975.645490:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4459340c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781975.656474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.656864:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874625023770240:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781975.656910:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.656938:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3800, rc 0) 00000100:00100000:3.0:1787781975.657040:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:10508:x1874625005927680:12345-192.168.202.56@tcp:101:bash.0 Request processed in 11905us (12288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781975.657051:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:2.0:1787781975.657209:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005927808 00000100:00100000:2.0:1787781975.657217:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005927808 00010000:00010000:2.0:1787781975.657268:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da2c expref: 7 pid: 6697 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781975.657299:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:2.0:1787781975.657310:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005927808:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781975.657328:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781975.657356:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da2c expref: 7 pid: 6697 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.657370:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da2c expref: 7 pid: 6697 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.657399:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb13e641/0x3ad9816c904546f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da2c expref: 7 pid: 6697 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.657436:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781975.657441:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781975.657452:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.657464:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.657507:0:8462:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781975.657524:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8462:1874625023770368:192.168.202.56@tcp:105: 00000100:00100000:2.0:1787781975.657589:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef473d59180 going to sleep for 11 seconds 00000100:00100000:0.0:1787781975.663188:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.663386:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005928064 00000100:00100000:3.0:1787781975.663398:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005928064 00000100:00100000:2.0:1787781975.663419:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8462:1874625023770368:192.168.202.56@tcp:105: 00010000:00010000:2.0:1787781975.663452:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781975.663474:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:3.0:1787781975.663484:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:10508:x1874625005928064:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:2.0:1787781975.663534:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005927808:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6225us (7073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781975.663544:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1787781975.663923:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:10508:x1874625005928064:12345-192.168.202.56@tcp:35:bash.0 Request processed in 438us (748us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787781975.663930:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1787781975.829980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.830227:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005928192 00000100:00100000:0.0:1787781975.830241:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005928192 00000100:00100000:0.0:1787781975.830381:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:0.0:1787781975.830394:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:10524:x1874625005928192:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787781975.830439:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781975.830469:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da3a expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.830559:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.830579:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.830594:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781975.830673:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787781975.830677:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787781975.830705:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.830735:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da3a expref: 36 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.830758:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da3a expref: 35 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.830768:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:0.0:1787781975.830771:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781975.830871:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031e00, rc 0) 00000100:00100000:0.0:1787781975.830958:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:10524:x1874625005928192:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 565us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781975.830967:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:1.0:1787781975.838270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.838439:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005928448 00000100:00100000:3.0:1787781975.838452:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005928448 00000100:00100000:3.0:1787781975.838578:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00100000:3.0:1787781975.838592:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:10524:x1874625005928448:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781975.838624:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781975.838651:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045470e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da41 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.838828:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.838848:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.838864:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781975.838878:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787781975.839086:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045470e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da41 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.839303:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da41 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.839315:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:3.0:1787781975.839319:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781975.839324:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3000, rc 0) 00000100:00100000:3.0:1787781975.839524:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:10524:x1874625005928448:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 820us (1166us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787781975.839534:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00100000:3.0:1787781975.846932:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781975.849767:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005928576 00000100:00100000:1.0:1787781975.849814:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005928576 00000100:00100000:1.0:1787781975.849912:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:1.0:1787781975.849926:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:2352:x1874625005928576:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781975.849946:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781975.849982:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da41 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.850030:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787781975.850036:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781975.850138:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:2352:x1874625005928576:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 216us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781975.850148:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:1.0:1787781975.861924:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781975.862061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005928832 00000100:00100000:2.0:1787781975.862074:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005928832 00000100:00100000:2.0:1787781975.862164:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 99 00000100:00100000:2.0:1787781975.862177:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:10524:x1874625005928832:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781975.862210:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781975.862238:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454723 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da48 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.862404:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045472a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.862438:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045472a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.862452:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045472a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781975.862468:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787781975.862634:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454723 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da48 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.862658:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045472a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da48 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.862668:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:2.0:1787781975.862672:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787781975.862676:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:2.0:1787781975.862765:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:10524:x1874625005928832:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 590us (856us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787781975.862774:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 99 00000100:00100000:0.0:1787781975.867877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781975.868052:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005928960 00000100:00100000:1.0:1787781975.868067:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005928960 00000100:00100000:1.0:1787781975.868331:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:1.0:1787781975.868346:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005928960:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:1.0:1787781975.868404:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.868498:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.868509:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781975.868514:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781975.868520:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.868564:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.868583:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 6 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781975.868622:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef481b6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874625023770496:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781975.868747:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef479103e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781975.873915:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.874197:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef481b6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874625023770496:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781975.874235:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781975.874357:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005929088 00000100:00100000:2.0:1787781975.874367:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005929088 00002000:00100000:2.0:1787781975.874660:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ef481b6e1c0 x1874625005929088/t0(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:121/0 lens 504/0 e 0 to 0 dl 1787781986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781975.874672:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef481b6e1c0 with x1874625005929088 ext(0->8) 00010000:00010000:2.0:1787781975.874700:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 7 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.874729:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 7 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781975.874738:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ef481b6e1c0 00000100:00100000:2.0:1787781975.874777:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:2.0:1787781975.874810:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2350:x1874625005929088:12345-192.168.202.56@tcp:4:lfs.0 00000100:00100000:2.0:1787781975.878981:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2350:x1874625005929088:12345-192.168.202.56@tcp:4:lfs.0 Request processed in 2314us (3200us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787781975.879002:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00002000:00100000:2.0:1787781975.879021:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ef481b6e1c0 x1874625005929088/t4294967302(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:121/0 lens 504/448 e 0 to 0 dl 1787781986 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781975.879034:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef481b6e1c0 with x1874625005929088 ext(0->8) 00010000:00010000:2.0:1787781975.879047:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 9 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781975.879066:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 9 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781975.879075:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ef481b6e1c0 00000100:00100000:2.0:1787781975.881673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.881776:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005929216 00000100:00100000:0.0:1787781975.881809:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005929216 00010000:00010000:0.0:1787781975.881863:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 9 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781975.881913:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:0.0:1787781975.881925:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2349:x1874625005929216:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781975.882016:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787781975.882044:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787781975.882048:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787781976 00002000:00010000:0.0:1787781975.882051:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787781976 00002000:00010000:0.0:1787781975.882053:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787781976 00010000:00010000:0.0:1787781975.882062:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 9 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.882078:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 9 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.883385:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f62a3844/0x3ad9816c904546f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da33 expref: 9 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.883409:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781975.883415:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781975.883422:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.883435:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.883486:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781975.883573:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2349:x1874625005929216:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1647us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781975.883585:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00010000:00010000:1.0:1787781975.885375:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.885398:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.885447:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.885458:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.885468:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.885477:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787781975.885482:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.885494:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.885550:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.885560:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023fed1b0/0x3ad9816c90454738 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781975.885678:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2351:x1874625005928960:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 17331us (17811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781975.885691:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:0.0:1787781975.888641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781975.888733:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005929472 00000100:00100000:3.0:1787781975.888746:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005929472 00000100:00100000:3.0:1787781975.888845:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:3.0:1787781975.888858:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff2cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:10524:x1874625005929472:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:3.0:1787781975.888955:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045472a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da48 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787781975.889308:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787781975.889360:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787781975.891216:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787781975.891340:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.891367:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da25 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.891401:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.891631:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da25 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781975.891654:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da25 expref: 42 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781975.891675:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9e940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874625023770624:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781975.892184:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4459349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781975.894999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.895185:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9e940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874625023770624:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781975.895223:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781975.895375:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005929600 00000100:00100000:1.0:1787781975.895385:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005929600 00010000:00010000:1.0:1787781975.895443:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da25 expref: 43 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781975.895489:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:1.0:1787781975.895501:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+43:2351:x1874625005929600:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781975.895519:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781975.895527:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da25 expref: 43 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.895542:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da25 expref: 43 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.895570:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c904546e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da25 expref: 43 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.895611:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787781975.895617:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.895628:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.895638:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781975.895670:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781975.895740:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+42:2351:x1874625005929600:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 241us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781975.895749:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00010000:00010000:0.0:1787781975.895932:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.895941:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781975.896134:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787781975.896431:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787781975.896563:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef450d6cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023770752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787781975.896629:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781975.896672:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4583383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781975.896703:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023770752 00000100:00100000:3.0:1787781975.896710:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023770752 00000100:00100000:3.0:1787781975.896772:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787781975.896781:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874625023770752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787781975.896892:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874625023770752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781975.896901:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787781975.896960:0:5837:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787781975.896968:0:5837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1787781975.896993:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef478a57840, transno 4294967301 00000100:00100000:0.0:1787781975.897006:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef450d6cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023770752:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1787781975.897214:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787781975.898727:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787781975.898867:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef450d6cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023770880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787781975.899093:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781975.899200:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef441254a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781975.902221:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023770880 00000100:00100000:3.0:1787781975.902244:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023770880 00000100:00100000:3.0:1787781975.902335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787781975.902349:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874625023770880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787781975.903417:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874625023770880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1065us (4469us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787781975.903452:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787781975.903576:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef450d6cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023770880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787781975.903680:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787781975.903739:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.903751:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.903759:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.903765:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781975.903770:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.903780:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.903842:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:0.0:1787781975.903845:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787781975.903852:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.903859:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c9045473f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787781975.904094:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787781975.904353:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787781975.904367:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343682577328ns, next at 344682574915ns, rc = 0 00000001:00080000:0.0:1787781975.904375:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787781975.904416:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:0.0:1787781975.904420:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787781975.904429:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c9045472a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da48 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781975.904557:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff2cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+45:10524:x1874625005929472:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 15702us (15931us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787781975.904568:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000020:00080000:0.0:1787781975.904573:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787781975.908935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.909130:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005929728 00000100:00100000:0.0:1787781975.909143:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005929728 00000100:00100000:0.0:1787781975.909233:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 100 00000100:00100000:0.0:1787781975.909245:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+45:10524:x1874625005929728:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787781975.909288:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781975.909319:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454746 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da4f expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.909432:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da4f expref: 46 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.909449:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da4f expref: 46 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781975.909474:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781975.909478:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787781975.909482:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031400, rc 0) 00000100:00100000:0.0:1787781975.909559:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+46:10524:x1874625005929728:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 316us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781975.909567:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 100 00000100:00100000:2.0:1787781975.912614:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781975.912722:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005929984 00000100:00100000:0.0:1787781975.912733:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005929984 00000100:00100000:0.0:1787781975.912832:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:0.0:1787781975.912844:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+46:10524:x1874625005929984:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1787781975.913156:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+47:10524:x1874625005929984:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 312us (555us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787781975.913165:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:3.0:1787781976.003340:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781976.003394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781976.003484:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005930112 00000100:00100000:0.0:1787781976.003496:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005930112 00000100:00100000:3.0:1787781976.003533:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781976.003569:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 288 00000100:00100000:0.0:1787781976.003580:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005930112:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781976.003667:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005930240 00000100:00100000:1.0:1787781976.003673:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005930240 00000100:00100000:0.0:1787781976.003675:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005930112:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781976.003696:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 288 00000100:00100000:1.0:1787781976.003724:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:1.0:1787781976.003734:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2350:x1874625005930240:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781976.003773:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2350:x1874625005930240:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 41us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781976.003781:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:2.0:1787781976.005344:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005930368 00000100:00100000:2.0:1787781976.005359:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005930368 00000100:00100000:2.0:1787781976.005455:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:2.0:1787781976.005465:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005930368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781976.005546:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005930368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 83us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781976.005554:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00080000:1.0:1787781976.005627:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781976.050730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781976.051324:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005930496 00000100:00100000:0.0:1787781976.051338:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005930496 00000100:00100000:1.0:1787781976.051571:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 101 00000100:00100000:1.0:1787781976.051585:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+47:10534:x1874625005930496:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:1.0:1787781976.051716:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.051739:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.051754:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.051771:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.051779:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.051810:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.051941:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.051950:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.051972:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781976.052028:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052043:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052061:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052070:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052077:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781976.052083:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052091:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052118:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:1.0:1787781976.052122:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781976.052128:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052136:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c9045474d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052154:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052161:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052169:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052175:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781976.052184:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052191:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052200:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef448467e00) 00010000:00010000:1.0:1787781976.052203:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781976.052217:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052224:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052241:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052248:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052287:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052292:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183fa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781976.052295:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052300:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052308:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:1.0:1787781976.052310:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781976.052320:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.052327:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c9045475b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781976.052434:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+47:10534:x1874625005930496:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 850us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781976.052442:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 101 00000100:00100000:0.0:1787781976.085531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781976.085782:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005930752 00000100:00100000:2.0:1787781976.085850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005930752 00000100:00100000:2.0:1787781976.085928:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 102 00000100:00100000:2.0:1787781976.085941:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+47:10537:x1874625005930752:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781976.085979:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781976.086007:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454762 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da56 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086112:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086131:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086146:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086166:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086194:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086213:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086392:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086402:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086409:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781976.086420:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787781976.086550:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086559:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086566:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086574:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781976.086578:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086587:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086613:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781976.086617:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781976.086622:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086628:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454769 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086644:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086651:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086658:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086664:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781976.086666:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086672:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086680:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef45088a400) 00010000:00010000:2.0:1787781976.086682:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781976.086685:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086691:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086752:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454762 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da56 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086768:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da56 expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.086776:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787781976.086778:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781976.086781:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414600, rc 0) 00000100:00100000:2.0:1787781976.086924:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+49:10537:x1874625005930752:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 985us (1408us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787781976.086934:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 102 00000100:00100000:3.0:1787781976.090853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781976.090975:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005930880 00000100:00100000:2.0:1787781976.090989:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005930880 00000100:00100000:2.0:1787781976.091060:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00100000:2.0:1787781976.091072:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+49:10537:x1874625005930880:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1787781976.091178:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.091200:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.091225:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.091266:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.091296:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.091304:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.091311:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781976.091316:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.091325:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.091339:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787781976.091343:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781976.091349:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.091356:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781976.091448:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+49:10537:x1874625005930880:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 377us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781976.091457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00100000:0.0:1787781976.097466:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781976.097582:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005931136 00000100:00100000:1.0:1787781976.097596:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005931136 00000100:00100000:1.0:1787781976.097672:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:1.0:1787781976.097684:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+49:10537:x1874625005931136:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1787781976.098045:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+50:10537:x1874625005931136:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 362us (593us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787781976.098054:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:0.0:1787781976.183422:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781976.183556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005931392 00000100:00100000:2.0:1787781976.183569:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005931392 00000100:00100000:2.0:1787781976.183642:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 104 00000100:00100000:2.0:1787781976.183653:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+50:10547:x1874625005931392:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781976.183688:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781976.183709:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787781976.183745:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da3a expref: 50 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.183769:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781976.183775:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781976.184006:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045478c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da5d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.184151:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.184167:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da56 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.184176:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.184217:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da56 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.184234:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da56 expref: 50 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781976.184250:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023771008:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781976.184419:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef473d59780 going to sleep for 11 seconds 00000100:00100000:0.0:1787781976.188749:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781976.189572:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005931520 00000100:00100000:1.0:1787781976.189588:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005931520 00010000:00010000:1.0:1787781976.189646:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da56 expref: 51 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781976.189706:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:1.0:1787781976.189717:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+51:2352:x1874625005931520:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781976.189736:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781976.189744:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da56 expref: 51 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.189760:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da56 expref: 51 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.189826:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:1.0:1787781976.189834:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.189849:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.189860:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.189888:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781976.189952:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+51:2352:x1874625005931520:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 236us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781976.189960:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00010000:00010000:2.0:1787781976.190219:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da56 expref: 50 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781976.190267:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023771008:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781976.190295:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.190305:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.190311:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781976.190335:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787781976.190535:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c9045478c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da5d expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.190551:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da5d expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.190558:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787781976.190561:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787781976.190563:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414a00, rc 0) 00000100:00100000:2.0:1787781976.190611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+50:10547:x1874625005931392:12345-192.168.202.56@tcp:101:bash.0 Request processed in 6959us (7203us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787781976.190619:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 104 00000100:00100000:0.0:1787781976.194923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781976.198323:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005931776 00000100:00100000:2.0:1787781976.198344:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005931776 00000100:00100000:2.0:1787781976.198522:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 105 00000100:00100000:2.0:1787781976.198534:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+50:10547:x1874625005931776:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:2.0:1787781976.198970:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.198991:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.199006:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781976.199067:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787781976.199093:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000319bf864 reply state 00000000e54f92f3 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781976.199103:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781976.199244:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+53:10547:x1874625005931776:12345-192.168.202.56@tcp:36:bash.0 Request processed in 711us (4336us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787781976.199263:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 105 00000020:00080000:2.0:1787781976.199270:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787781976.203746:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.203769:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.203778:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.203785:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781976.203812:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.203822:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.203866:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:1.0:1787781976.203869:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781976.203875:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.203882:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781976.205770:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781976.206217:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005931904 00000100:00100000:3.0:1787781976.206230:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005931904 00000100:00100000:3.0:1787781976.206313:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 106 00000100:00100000:3.0:1787781976.206324:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+52:10547:x1874625005931904:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1787781976.206356:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781976.206383:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904547a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.206491:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.206509:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da5d expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.206519:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.206561:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da5d expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.206578:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da5d expref: 53 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781976.206593:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478b36d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023771136:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781976.206743:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4459349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781976.213646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781976.214183:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005932032 00000100:00100000:1.0:1787781976.214196:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005932032 00010000:00010000:1.0:1787781976.214272:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da5d expref: 54 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781976.214319:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:1.0:1787781976.214329:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:2351:x1874625005932032:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781976.214350:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781976.214358:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da5d expref: 54 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.214374:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da5d expref: 54 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.214403:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:1.0:1787781976.214410:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.214421:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.214452:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.214476:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781976.214537:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:2351:x1874625005932032:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 209us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781976.214545:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00010000:00010000:3.0:1787781976.215724:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454793 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da5d expref: 53 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781976.215764:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478b36d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023771136:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781976.215825:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.215834:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.215839:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781976.215892:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787781976.215896:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781976.215914:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.215945:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904547a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da64 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.215961:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da64 expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.215969:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:3.0:1787781976.215972:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781976.215976:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2000, rc 0) 00000100:00100000:3.0:1787781976.216068:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+52:10547:x1874625005931904:12345-192.168.202.56@tcp:101:bash.0 Request processed in 9746us (10313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781976.216076:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 106 00000100:00100000:0.0:1787781976.223198:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781976.223349:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005932288 00000100:00100000:2.0:1787781976.223361:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005932288 00000100:00100000:2.0:1787781976.223461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:2.0:1787781976.223474:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+52:10547:x1874625005932288:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:2.0:1787781976.223861:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+53:10547:x1874625005932288:12345-192.168.202.56@tcp:35:bash.0 Request processed in 386us (676us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787781976.223874:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:1.0:1787781976.281323:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781976.281522:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005932416 00000100:00100000:2.0:1787781976.281536:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005932416 00000100:00100000:2.0:1787781976.281618:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:2.0:1787781976.281630:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+53:10553:x1874625005932416:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781976.281682:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781976.281710:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da6b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.281942:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904547bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.281962:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904547bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.281980:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904547bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781976.282067:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787781976.282071:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781976.282172:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904547bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.282206:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da6b expref: 55 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.282229:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904547bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da6b expref: 54 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.282239:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781976.282242:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781976.282247:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414600, rc 0) 00000100:00100000:2.0:1787781976.282395:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:10553:x1874625005932416:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 767us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781976.282404:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:0.0:1787781976.287010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781976.287129:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005932544 00000100:00100000:2.0:1787781976.287141:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005932544 00000100:00100000:2.0:1787781976.287214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:2.0:1787781976.287226:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:10553:x1874625005932544:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781976.287263:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781976.287292:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c904547c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da72 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287378:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287396:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287410:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287428:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287436:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287443:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287574:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904547d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287583:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904547d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287604:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904547d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781976.287649:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787781976.287653:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781976.287674:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904547d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287688:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904547d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287698:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287705:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287712:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287719:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781976.287724:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287733:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287747:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781976.287751:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781976.287757:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287774:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904547cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287834:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287842:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287848:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287854:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781976.287857:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287863:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287871:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef45088a400) 00010000:00010000:2.0:1787781976.287873:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781976.287876:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287882:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287918:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c904547c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da72 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287933:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904547d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da72 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.287947:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787781976.287950:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781976.287953:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:2.0:1787781976.288039:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:10553:x1874625005932544:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 814us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781976.288047:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:0.0:1787781976.293125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781976.293178:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781976.293368:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005932928 00000100:00100000:3.0:1787781976.293380:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005932928 00000100:00100000:3.0:1787781976.293462:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1787781976.293474:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:2349:x1874625005932928:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781976.293494:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781976.293529:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c904547d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da72 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.293552:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:3.0:1787781976.293559:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781976.293635:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:2349:x1874625005932928:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 163us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781976.293643:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1787781976.294463:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005932800 00000100:00100000:2.0:1787781976.294472:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005932800 00000100:00100000:2.0:1787781976.294527:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 109 00000100:00100000:2.0:1787781976.294536:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:10553:x1874625005932800:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781976.294558:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781976.294579:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c904547e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da79 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.294710:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.294729:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da64 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.294740:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.294782:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da64 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.294927:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da64 expref: 55 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781976.294963:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023771264:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781976.295223:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef473d59600 going to sleep for 11 seconds 00000100:00100000:1.0:1787781976.299520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781976.299607:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005933056 00000100:00100000:3.0:1787781976.299618:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005933056 00010000:00010000:3.0:1787781976.299672:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da64 expref: 56 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781976.299724:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:3.0:1787781976.299735:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:2352:x1874625005933056:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781976.299754:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781976.299762:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da64 expref: 56 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.299777:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da64 expref: 56 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.299854:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:3.0:1787781976.299861:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.299873:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.299883:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.299907:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781976.300167:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:2352:x1874625005933056:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 432us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781976.300178:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00010000:00010000:2.0:1787781976.301656:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2000/0x3ad9816c904547af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da64 expref: 55 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781976.301687:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023771264:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781976.301718:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.301729:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.301735:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781976.301761:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787781976.302033:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c904547e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da79 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.302052:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da79 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.302061:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787781976.302064:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787781976.302068:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414400, rc 0) 00000100:00100000:2.0:1787781976.302154:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:10553:x1874625005932800:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 7618us (9045us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787781976.302188:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 109 00000100:00100000:1.0:1787781976.305738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781976.305907:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005933312 00000100:00100000:3.0:1787781976.305919:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005933312 00000100:00100000:3.0:1787781976.306003:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:3.0:1787781976.306014:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:10553:x1874625005933312:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:3.0:1787781976.306037:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781976.306069:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da4f expref: 55 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781976.306106:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:3.0:1787781976.306113:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781976.306332:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:10553:x1874625005933312:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 318us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781976.306341:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:1.0:1787781976.309390:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781976.309494:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005933440 00000100:00100000:2.0:1787781976.309506:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005933440 00000100:00100000:2.0:1787781976.309611:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 110 00000100:00100000:2.0:1787781976.309623:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:10553:x1874625005933440:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:2.0:1787781976.309816:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.309838:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781976.309852:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787781976.310304:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787781976.310486:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:10553:x1874625005933440:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 862us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781976.310495:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 110 00000100:00100000:2.0:1787781976.313371:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781976.313475:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005933568 00000100:00100000:1.0:1787781976.313489:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005933568 00000100:00100000:1.0:1787781976.313591:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 111 00000100:00100000:1.0:1787781976.313604:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:10553:x1874625005933568:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781976.313632:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781976.313663:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904547fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da80 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.313743:0:9081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.313758:0:9081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904547fc lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da80 expref: 55 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.313782:0:9081:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.313855:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904547fc lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da80 expref: 55 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.313872:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:1.0:1787781976.313876:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787781976.313880:0:9081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904547fc lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da80 expref: 55 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781976.313889:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183fa00, rc 0) 00000100:00100000:1.0:1787781976.313971:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:10553:x1874625005933568:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 369us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781976.313979:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 111 00010000:00010000:1.0:1787781976.318075:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781976.958670:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781976.958685:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787781976.958735:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787781976.958742:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787781976.959058:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478b36d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023771392:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787781976.959443:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445934d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781976.969646:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478b36d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023771392:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787781976.977715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781976.980718:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005933696 00000100:00100000:3.0:1787781976.980738:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005933696 00000100:00100000:3.0:1787781976.980861:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:3.0:1787781976.980874:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:10554:x1874625005933696:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787781976.980916:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787781976.983711:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:10554:x1874625005933696:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 2580us (5751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781976.983730:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:2.0:1787781977.001675:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781977.001784:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005933824 00000100:00100000:0.0:1787781977.001847:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005933824 00000100:00100000:0.0:1787781977.001949:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00080000:1.0:1787781977.002136:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781977.002563:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:10554:x1874625005933824:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787781977.002667:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.002690:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.002703:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003032:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003058:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003071:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003106:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003115:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003121:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781977.003168:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787781977.003172:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787781977.003189:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003199:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003205:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003211:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003236:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.003240:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003262:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003276:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:0.0:1787781977.003279:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781977.003283:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003291:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454803 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003307:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003312:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003318:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003323:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.003326:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003331:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003350:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9ef44a9a7900) 00010000:00010000:0.0:1787781977.003352:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781977.003355:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003362:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045480a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003378:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003384:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003389:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003394:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.003397:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003403:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003410:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781977.003412:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781977.003415:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.003421:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.003591:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:10554:x1874625005933824:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 1628us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.003602:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00100000:0.0:1787781977.012685:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.012782:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005934080 00000100:00100000:2.0:1787781977.012855:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005934080 00000100:00100000:2.0:1787781977.012916:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 114 00000100:00100000:2.0:1787781977.012927:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:10554:x1874625005934080:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781977.012948:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781977.012970:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454818 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da87 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013097:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013112:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013123:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781977.013133:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787781977.013236:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013253:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013260:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013265:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781977.013270:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013277:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013289:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787781977.013292:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787781977.013296:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013314:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045481f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013357:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454818 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da87 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013368:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:2.0:1787781977.013370:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781977.013373:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454818 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da87 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.013382:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415000, rc 0) 00000100:00100000:2.0:1787781977.013443:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:10554:x1874625005934080:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 517us (768us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787781977.013450:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 114 00000100:00100000:1.0:1787781977.017888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.017987:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005934208 00000100:00100000:2.0:1787781977.017997:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005934208 00000100:00100000:2.0:1787781977.018046:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:2.0:1787781977.018055:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:10554:x1874625005934208:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787781977.018100:0:9081:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787781977.018215:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:10554:x1874625005934208:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 160us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.018223:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:0.0:1787781977.023755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.024061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005934464 00000100:00100000:2.0:1787781977.024071:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005934464 00000100:00100000:2.0:1787781977.024140:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:2.0:1787781977.024163:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:10554:x1874625005934464:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781977.024183:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781977.024186:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787781977.024223:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c904547bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da6b expref: 56 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.024251:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781977.024256:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781977.024270:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c9045482d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da8e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787781977.024679:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787781977.024899:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454834 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.024912:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.024922:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.024968:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c9045482d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da8e expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.024983:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da8e expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.024991:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088a400) 00010000:00010000:2.0:1787781977.024994:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781977.025004:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415200, rc 0) 00000100:00100000:2.0:1787781977.025071:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+57:10554:x1874625005934464:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 909us (1326us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787781977.025080:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:3.0:1787781977.030122:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.030371:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005934720 00000100:00100000:2.0:1787781977.030382:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005934720 00000100:00100000:2.0:1787781977.030479:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:2.0:1787781977.030490:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+57:10554:x1874625005934720:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787781977.030581:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781977.030609:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454834 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da8e expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030628:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088a400) 00010000:00010000:2.0:1787781977.030646:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781977.030665:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030678:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030688:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030701:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030708:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030714:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030818:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030825:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030831:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030837:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781977.030842:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030848:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030856:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787781977.030859:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781977.030863:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030868:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454842 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030876:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030882:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030887:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030900:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781977.030903:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030909:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030916:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xad71444e (ffff9ef45088ab00) 00010000:00010000:2.0:1787781977.030918:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781977.030921:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.030926:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454849 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xad71444e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781977.031070:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:10554:x1874625005934720:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 581us (955us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787781977.031078:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:1.0:1787781977.035345:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.035419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005934848 00000100:00100000:2.0:1787781977.035428:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005934848 00000100:00100000:2.0:1787781977.035482:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:2.0:1787781977.035492:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:10554:x1874625005934848:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781977.035511:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781977.035534:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454850 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da95 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.035887:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.035916:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.035927:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.036023:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da95 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.036042:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da95 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.036050:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787781977.036053:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787781977.036057:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414a00, rc 0) 00000100:00100000:2.0:1787781977.036114:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+57:10554:x1874625005934848:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 622us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.036121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:1.0:1787781977.042646:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781977.042922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005935104 00000100:00100000:0.0:1787781977.042932:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005935104 00000100:00100000:0.0:1787781977.042993:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:0.0:1787781977.043004:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+57:10554:x1874625005935104:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787781977.043097:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.043118:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.043130:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781977.043387:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1787781977.043397:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344821607996ns, next at 345821605237ns, rc = 0 00000004:00010000:0.0:1787781977.043490:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d45c32dc reply state 0000000017dc8f01 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.043500:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781977.043912:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:10554:x1874625005935104:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 907us (1273us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787781977.043920:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:3.0:1787781977.050512:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.050642:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005935232 00000100:00100000:2.0:1787781977.050652:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005935232 00000100:00100000:2.0:1787781977.050709:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:2.0:1787781977.050719:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:10554:x1874625005935232:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781977.050743:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781977.050764:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140da9c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.050854:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da9c expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.050882:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da9c expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.050903:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787781977.050906:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781977.050909:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:2.0:1787781977.050961:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:10554:x1874625005935232:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 242us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.050968:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:0.0:1787781977.053909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781977.054049:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005935360 00000100:00100000:3.0:1787781977.054059:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005935360 00000100:00100000:3.0:1787781977.054144:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:3.0:1787781977.054155:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2349:x1874625005935360:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787781977.054296:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787781977.055342:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2349:x1874625005935360:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 1185us (1439us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787781977.055352:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00010000:00010000:1.0:1787781977.055502:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.055513:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.055521:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.055527:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781977.055532:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.055549:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.055577:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:1.0:1787781977.055579:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787781977.055584:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.055590:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c9045485e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.057402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781977.057471:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005935616 00000100:00100000:3.0:1787781977.057479:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005935616 00000100:00100000:3.0:1787781977.057536:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:3.0:1787781977.057545:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:10554:x1874625005935616:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787781977.058511:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:10554:x1874625005935616:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 544us (692us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787781977.058522:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:0.0:1787781977.064005:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.068641:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005935872 00000100:00100000:2.0:1787781977.068658:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005935872 00000100:00100000:2.0:1787781977.068729:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:2.0:1787781977.068741:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:10554:x1874625005935872:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787781977.068891:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:10554:x1874625005935872:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 151us (4895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.068899:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:0.0:1787781977.071478:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.071704:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005936000 00000100:00100000:2.0:1787781977.071712:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005936000 00000100:00100000:2.0:1787781977.071769:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:2.0:1787781977.071779:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:10554:x1874625005936000:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781977.071835:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781977.071873:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045486c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140daa3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.071945:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454873 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.071960:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.071973:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781977.072009:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781977.072028:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.072055:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c9045486c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daa3 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.072073:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daa3 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.072082:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787781977.072085:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787781977.072099:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414600, rc 0) 00000100:00100000:2.0:1787781977.072149:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:10554:x1874625005936000:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 372us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.072157:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:3.0:1787781977.079932:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781977.080061:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005936128 00000100:00100000:0.0:1787781977.080071:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005936128 00000100:00100000:0.0:1787781977.080137:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:0.0:1787781977.080146:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2351:x1874625005936128:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781977.080165:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781977.080189:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140daaa expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787781977.080228:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f635a, blocks: 0x1 00010000:00010000:0.0:1787781977.080256:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1787781977.080261:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781977.080270:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daaa expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.080289:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daaa expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.080302:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031600, rc 0) 00000100:00100000:0.0:1787781977.080365:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b34780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:2351:x1874625005936128:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 220us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.080373:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:0.0:1787781977.082991:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.085328:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005936384 00000100:00100000:2.0:1787781977.085342:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005936384 00000100:00100000:0.0:1787781977.088921:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:0.0:1787781977.088952:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:10554:x1874625005936384:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787781977.089151:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:10554:x1874625005936384:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 203us (6167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.089160:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:3.0:1787781977.098763:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.098948:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005936512 00000100:00100000:2.0:1787781977.098958:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005936512 00000100:00100000:2.0:1787781977.099015:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:2.0:1787781977.099024:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:10554:x1874625005936512:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781977.099041:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781977.099058:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dab1 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.099087:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daaa expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.099105:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781977.099109:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781977.099115:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.099147:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daaa expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.099161:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daaa expref: 11 pid: 6695 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781977.099175:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874625023771520:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781977.099296:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef473d59780 going to sleep for 11 seconds 00000100:00100000:1.0:1787781977.108837:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781977.108926:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005936640 00000100:00100000:3.0:1787781977.108935:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005936640 00010000:00010000:3.0:1787781977.108980:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daaa expref: 12 pid: 6695 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781977.109527:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:3.0:1787781977.109539:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:2352:x1874625005936640:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781977.109648:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781977.109675:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daaa expref: 12 pid: 6695 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.109691:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daaa expref: 12 pid: 6695 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.109717:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781977.109723:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781977.109731:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.109742:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.109827:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781977.109843:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478b35e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1874625023771648:192.168.202.56@tcp:105: 00000100:00100000:3.0:1787781977.109915:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445934d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787781977.110596:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c9045487a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daaa expref: 12 pid: 6695 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781977.110625:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874625023771520:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781977.110650:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.110662:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415400, rc 0) 00000100:00100000:2.0:1787781977.110709:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:10554:x1874625005936512:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 11685us (11956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.110717:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:3.0:1787781977.117533:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478b35e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1874625023771648:192.168.202.56@tcp:105: 00010000:00010000:3.0:1787781977.117568:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781977.117638:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:2352:x1874625005936640:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 8101us (8850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781977.117649:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1787781977.118185:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781977.119207:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005936768 00000100:00100000:1.0:1787781977.119217:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005936768 00002000:00100000:1.0:1787781977.119276:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ef4790ed680 x1874625005936768/t0(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:123/0 lens 504/0 e 0 to 0 dl 1787781988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781977.119287:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef4790ed680 with x1874625005936768 ext(0->12) 00002000:00010000:1.0:1787781977.119293:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef4790ed680 00000100:00100000:1.0:1787781977.119327:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1787781977.119337:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:2351:x1874625005936768:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787781977.120133:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:2351:x1874625005936768:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 793us (1945us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787781977.120144:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00002000:00100000:1.0:1787781977.120152:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ef4790ed680 x1874625005936768/t4294967308(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:123/0 lens 504/448 e 0 to 0 dl 1787781988 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781977.120162:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef4790ed680 with x1874625005936768 ext(0->12) 00002000:00010000:1.0:1787781977.120172:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef4790ed680 00000100:00100000:0.0:1787781977.131515:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.131676:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005936896 00000100:00100000:2.0:1787781977.131685:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005936896 00000100:00100000:2.0:1787781977.131732:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:2.0:1787781977.131740:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:10554:x1874625005936896:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787781977.219740:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:10554:x1874625005936896:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 87989us (88224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.219753:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 124 00000001:00080000:3.0:1787781977.220443:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1787781977.220453:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1787781977.220482:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787781977.220505:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef4412ed900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787781977.220510:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef446414b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef460e82c00 00000020:00080000:3.0:1787781977.220513:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef446414700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef47f972000 00000001:00080000:3.0:1787781977.220552:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787781977.220578:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787781977.220613:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef4467506c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787781977.220616:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef46a14ca00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef441377b40 00000020:00080000:3.0:1787781977.220618:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef46a14cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef476aa5c00 00000020:00080000:3.0:1787781977.220629:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787781977.220832:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787781977.221347:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787781977.221365:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023771776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787781977.221426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781977.221729:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781977.221739:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef481b6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023771904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787781977.221775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781977.221817:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023771776 00000100:00100000:2.0:1787781977.221825:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023771776 00000100:00100000:0.0:1787781977.221842:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef481b6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023772032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787781977.221873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781977.221876:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023771904 00000100:00100000:2.0:1787781977.221881:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023771904 00000100:00100000:2.0:1787781977.221904:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023772032 00000100:00100000:2.0:1787781977.221907:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023772032 00000100:00080000:0.0:1787781977.221909:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781977.221915:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781977.221926:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787781977.221933:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787781977.221937:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b35e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023771776:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787781977.221947:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1874625023771904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787781977.221970:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00080000:2.0:1787781977.221971:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1787781977.221995:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781977.222006:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f6358, atime: 0x6a8f6358, ctime: 0x6a8f6358, blocks: 0x1 00010000:00010000:2.0:1787781977.222014:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.222019:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da10 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.222031:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1787781977.222034:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787781977.222037:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781977.222039:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781977.222045:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.222046:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.222074:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.222102:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.222110:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da10 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.222112:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.222137:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da10 expref: 11 pid: 6695 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.222141:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787781977.222154:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790eda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874625023772160:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781977.222219:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18180 going to sleep for 11 seconds 00000100:00100000:2.0:1787781977.223223:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b35e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874625023771776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1286us (1794us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787781977.223233:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787781977.223265:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787781977.223273:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874625023772032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787781977.223383:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787781977.223387:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787781978 00002000:00010000:2.0:1787781977.223390:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787781977.223401:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787781978 -> 1787781978 00002000:00010000:2.0:1787781977.223403:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:3.0:1787781977.224096:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef47f3e5a40/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787781977.224105:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023771776:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787781977.224325:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781977.224334:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.224346:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781977.224350:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.224361:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.224383:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.224391:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045488f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.224410:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781977.224422:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781977.224424:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781977.224557:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3305:x1874625023772032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1284us (2683us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787781977.224565:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1787781977.224603:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef481b6de00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787781977.224610:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef481b6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023772032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787781977.224750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.225123:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790eda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874625023772160:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781977.225146:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781977.225450:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005937024 00000100:00100000:3.0:1787781977.225457:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005937024 00000100:00100000:3.0:1787781977.225515:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:3.0:1787781977.225524:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:2351:x1874625005937024:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787781977.225684:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781977.225741:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005937152 00000100:00100000:3.0:1787781977.225745:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005937152 00010000:00010000:3.0:1787781977.225764:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da10 expref: 13 pid: 6695 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781977.225892:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:3.0:1787781977.225900:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:2352:x1874625005937152:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781977.225911:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781977.225916:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da10 expref: 13 pid: 6695 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.225929:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da10 expref: 13 pid: 6695 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.225950:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c9045464a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da10 expref: 13 pid: 6695 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.225964:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1787781977.225969:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781977.225975:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.225985:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.226016:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781977.226100:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:2352:x1874625005937152:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 200us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781977.226108:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00010000:00010000:0.0:1787781977.226158:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.226167:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.226177:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.226185:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.226203:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787781977.226840:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787781977.226849:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.226859:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787781977.226864:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.226875:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.226888:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3303:x1874625023771904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4943us (5111us total) trans 4294967310 rc 0/0 00010000:00010000:2.0:1787781977.226891:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.226905:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90454888 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.226911:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1787781977.226933:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781977.226942:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781977.226945:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787781977.227122:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef481b6c780/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787781977.227129:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef481b6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023771904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787781977.278113:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476aa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023772672:0@lo:400:kworker.0 00000100:00100000:0.0:1787781977.278183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781977.278232:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781977.278239:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023772288:0@lo:400:kworker.0 00000100:00100000:0.0:1787781977.278276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781977.278310:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023772416:0@lo:400:kworker.0 00000100:00100000:0.0:1787781977.278334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781977.278355:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787781977.278360:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023772544:0@lo:400:kworker.0 00000100:00100000:0.0:1787781977.278381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781977.278408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023772672 00000100:00100000:0.0:1787781977.278414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023772672 00000100:00100000:0.0:1787781977.278462:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023772416 00000100:00100000:0.0:1787781977.278465:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023772416 00000100:00100000:0.0:1787781977.278478:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023772544 00000100:00100000:0.0:1787781977.278481:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023772544 00000100:00100000:0.0:1787781977.278501:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787781977.278509:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023772672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781977.278571:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023772672:12345-0@lo:400:kworker.0 Request processed in 62us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.278578:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787781977.278595:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787781977.278601:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023772416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781977.278652:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023772416:12345-0@lo:400:kworker.0 Request processed in 51us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.278658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787781977.278670:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787781977.278676:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023772544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781977.278701:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023772544:12345-0@lo:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.278706:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1787781977.278721:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781977.278751:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476aa2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023772544:0@lo:400:kworker.0 00000100:00100000:0.0:1787781977.278762:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023772416:0@lo:400:kworker.0 00000100:00100000:0.0:1787781977.278809:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476aa30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023772672:0@lo:400:kworker.0 00000100:00100000:3.0:1787781977.279371:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023772288 00000100:00100000:3.0:1787781977.279377:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023772288 00000100:00100000:3.0:1787781977.279408:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787781977.279415:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023772288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781977.279462:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023772288:12345-0@lo:400:kworker.0 Request processed in 47us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781977.279467:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787781977.279508:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023772288:0@lo:400:kworker.0 00000100:00100000:3.0:1787781977.279696:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476aa03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023772800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781977.279727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781977.279820:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023772800 00000100:00100000:2.0:1787781977.279825:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023772800 00000100:00100000:2.0:1787781977.279850:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787781977.279857:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1874625023772800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787781977.279872:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781977.279906:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1874625023772800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.279912:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787781977.279987:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476aa03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023772800:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787781977.298135:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1787781977.298163:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1787781977.298391:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005937024:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 72862us (73636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781977.298403:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:2.0:1787781977.302281:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781977.302379:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005937408 00000100:00100000:0.0:1787781977.302389:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005937408 00000100:00100000:0.0:1787781977.302472:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:0.0:1787781977.302483:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:10554:x1874625005937408:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787781977.302533:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781977.302561:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414600/0x3ad9816c90454873 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daa3 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.302579:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:0.0:1787781977.302585:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781977.302615:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.302645:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.302655:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781977.302985:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e610154d reply state 00000000e8ccc70e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.302994:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781977.303429:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:10554:x1874625005937408:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 603us (813us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787781977.303441:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 125 00010000:00010000:3.0:1787781977.306360:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.306379:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.306386:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.306409:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781977.306414:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.306422:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.306438:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:3.0:1787781977.306441:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781977.306446:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.306452:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454896 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781977.307999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781977.308275:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005937536 00000100:00100000:0.0:1787781977.308285:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005937536 00000100:00100000:0.0:1787781977.308347:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:0.0:1787781977.308357:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005937536:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787781977.308578:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787781977.308582:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787781978 -> 1787781977 00002000:00010000:0.0:1787781977.308584:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787781976 00002000:00010000:0.0:1787781977.308586:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787781978 -> 1787781977 00002000:00010000:0.0:1787781977.308588:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787781977.308649:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005937536:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 293us (657us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787781977.308657:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:1.0:1787781977.312141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.312292:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005937792 00000100:00100000:2.0:1787781977.312301:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005937792 00000100:00100000:2.0:1787781977.312361:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:2.0:1787781977.312371:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:10554:x1874625005937792:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787781977.312439:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.312456:0:9081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da95 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.312465:0:9081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.312501:0:9081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da95 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.312530:0:9081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da95 expref: 15 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781977.312545:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476aa0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023772928:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781977.312633:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448b67480 going to sleep for 11 seconds 00000100:00100000:0.0:1787781977.315726:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476aa0780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023772928:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781977.315759:0:9081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781977.316839:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.317077:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005937920 00000100:00100000:2.0:1787781977.317096:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005937920 00010000:00010000:2.0:1787781977.317135:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da95 expref: 16 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781977.317175:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:2.0:1787781977.317185:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:2351:x1874625005937920:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781977.317206:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781977.317212:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da95 expref: 16 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.317225:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da95 expref: 16 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.317257:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da95 expref: 16 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.317274:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787781977.317278:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.317298:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.317306:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.317328:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781977.317387:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:2351:x1874625005937920:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 203us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781977.317395:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00010000:00010000:0.0:1787781977.317758:0:9081:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.317768:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.317831:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.317839:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.317846:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.317852:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.317855:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.317863:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.317872:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:0.0:1787781977.317875:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787781977.317879:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.317885:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c9045489d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.317933:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:10554:x1874625005937792:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 5564us (5802us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787781977.317949:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:1.0:1787781977.323157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781977.323235:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005938048 00000100:00100000:0.0:1787781977.323253:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005938048 00000100:00100000:0.0:1787781977.323315:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:0.0:1787781977.323326:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005938048:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787781977.323373:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.323394:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.323404:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787781977.323408:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781977.323413:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.323448:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.323463:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 7 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.323478:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790ef0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874625023773056:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781977.323560:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781977.327462:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781977.327554:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005938176 00000100:00100000:1.0:1787781977.327563:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005938176 00010000:00010000:1.0:1787781977.327603:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 8 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781977.327645:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:1.0:1787781977.327654:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2352:x1874625005938176:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781977.327669:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781977.327693:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 8 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.327707:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 8 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.327733:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781977.327737:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781977.327741:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.327750:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.327784:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781977.327861:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2352:x1874625005938176:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 208us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781977.327869:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00010000:00010000:0.0:1787781977.328010:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c74108/0x3ad9816c90454881 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab1 expref: 7 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.328031:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790ef0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874625023773056:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781977.328052:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.328062:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.328070:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.328092:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.328099:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.328106:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.328113:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787781977.328117:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.328127:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.328148:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.328155:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904548a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.328212:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005938048:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 4888us (5063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.328220:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:1.0:1787781977.331198:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781977.331306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005938432 00000100:00100000:2.0:1787781977.331315:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005938432 00000100:00100000:2.0:1787781977.331370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:2.0:1787781977.331379:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:10554:x1874625005938432:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787781977.331453:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.331467:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.331475:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.331628:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.331635:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da9c expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.331654:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.331679:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da9c expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781977.331688:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da9c expref: 15 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781977.331698:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476aa30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023773184:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781977.331764:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448b676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781977.334885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781977.334947:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005938560 00000100:00100000:1.0:1787781977.334956:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005938560 00010000:00010000:1.0:1787781977.334994:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da9c expref: 16 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781977.335022:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:1.0:1787781977.335028:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:2351:x1874625005938560:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781977.335040:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781977.335045:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da9c expref: 16 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.335054:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da9c expref: 16 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.335072:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:1.0:1787781977.335078:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.335091:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.335098:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.335131:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781977.335184:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:2351:x1874625005938560:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 155us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781977.335200:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00010000:00010000:0.0:1787781977.335372:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da9c expref: 15 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.335384:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476aa30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023773184:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781977.335400:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.335406:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.335410:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781977.335549:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787781977.335649:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787781977.335677:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787781977.335743:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023773312:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787781977.335822:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781977.335842:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781977.336650:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023773312 00000100:00100000:1.0:1787781977.336657:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023773312 00000100:00100000:1.0:1787781977.336693:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787781977.336699:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874625023773312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787781977.336776:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874625023773312:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781977.336781:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787781977.337104:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787781977.337111:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1787781977.337129:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef481b6de00, transno 4294967309 00000100:00100000:0.0:1787781977.337142:0:5835:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ef481b6c780 x1874625023771904/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787781993 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787781977.337152:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023773312:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787781977.337633:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787781977.337701:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023773440:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787781977.337744:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781977.337778:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781977.338095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023773440 00000100:00100000:1.0:1787781977.338101:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023773440 00000100:00100000:1.0:1787781977.338139:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787781977.338147:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874625023773440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787781977.338338:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1874625023773440:12345-0@lo:1000:mdt00_002.0 Request processed in 191us (593us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787781977.338345:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787781977.338457:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023773440:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787781977.338488:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338497:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338504:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338511:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.338515:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338523:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338552:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:0.0:1787781977.338555:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787781977.338560:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338565:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c904548b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338599:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338605:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338611:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338615:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.338617:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338623:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338631:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781977.338633:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787781977.338641:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904547fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da80 expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338652:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904547fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da80 expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338669:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904547fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da80 expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.338697:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904547fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da80 expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.338709:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023773568:192.168.202.56@tcp:105: 00000100:00100000:0.0:1787781977.338775:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781977.342945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781977.343278:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023773568:192.168.202.56@tcp:105: 00010000:00010000:0.0:1787781977.343309:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343321:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c904547f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343351:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343366:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343377:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343388:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343394:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343410:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343415:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.343420:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343426:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343439:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781977.343442:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781977.343446:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343450:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343459:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343464:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343469:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343473:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.343475:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343489:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343497:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781977.343499:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787781977.343502:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.343508:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.343717:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446979680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:10554:x1874625005938432:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 12337us (12535us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787781977.343727:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00000020:00080000:0.0:1787781977.343733:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787781977.344162:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781977.344166:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781977.344660:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787781977.344669:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787781977.344942:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005938688 00000100:00100000:3.0:1787781977.344950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005938688 00000100:00100000:3.0:1787781977.345001:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:3.0:1787781977.345011:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:10553:x1874625005938688:12345-192.168.202.56@tcp:49:lfs.0 00010000:00010000:1.0:1787781977.345355:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781977.345393:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:10553:x1874625005938688:12345-192.168.202.56@tcp:49:lfs.0 Request processed in 383us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781977.345402:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:2.0:1787781977.350738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781977.350916:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005938944 00000100:00100000:3.0:1787781977.350925:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005938944 00000100:00100000:3.0:1787781977.350983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:3.0:1787781977.350992:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff2dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:10554:x1874625005938944:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787781977.351677:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787781977.351828:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787781977.351874:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.351890:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.351901:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.351909:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.351914:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.351920:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.351937:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787781977.352041:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff2dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10554:x1874625005938944:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1047us (1311us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787781977.352049:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00000020:00080000:3.0:1787781977.352055:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787781977.352769:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781977.352777:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.352785:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787781977.352820:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.352842:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.352855:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ef44a7dbb00) 00010000:00010000:1.0:1787781977.352857:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787781977.352862:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.352867:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c904548c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781977.352885:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781977.352887:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781977.352888:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781977.354376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781977.354757:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005939200 00000100:00100000:3.0:1787781977.354766:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005939200 00000100:00100000:3.0:1787781977.354988:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:3.0:1787781977.355000:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10553:x1874625005939200:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:3.0:1787781977.355433:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787781977.355519:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10553:x1874625005939200:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 520us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781977.355543:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:3.0:1787781977.391896:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781977.391996:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005939328 00000100:00100000:0.0:1787781977.392006:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005939328 00000100:00100000:0.0:1787781977.392066:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:0.0:1787781977.392075:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:10556:x1874625005939328:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787781977.392107:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781977.392127:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dab8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392188:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392213:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392256:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392273:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392280:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392287:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392540:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392551:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da79 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392573:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392604:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da79 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.392618:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da79 expref: 21 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781977.392631:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023773696:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781977.392709:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787781977.400523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781977.400905:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005939584 00000100:00100000:3.0:1787781977.400915:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005939584 00000100:00100000:3.0:1787781977.400980:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:3.0:1787781977.400990:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:5587:x1874625005939584:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787781977.401226:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:5587:x1874625005939584:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 237us (712us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787781977.401234:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:1.0:1787781977.401631:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a56d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023773696:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787781977.401661:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781977.403770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781977.404079:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005939712 00000100:00100000:3.0:1787781977.404096:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005939712 00010000:00010000:3.0:1787781977.404136:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da79 expref: 23 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781977.404175:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1787781977.404184:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:2352:x1874625005939712:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781977.404206:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781977.404213:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da79 expref: 23 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.404227:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da79 expref: 23 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.404275:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c904547e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da79 expref: 23 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.404311:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:3.0:1787781977.404316:0:8462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.404325:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.404333:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781977.404411:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781977.404465:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:2352:x1874625005939712:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 282us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781977.404473:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00010000:00010000:0.0:1787781977.406376:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406390:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781977.406433:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787781977.406437:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787781977.406460:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406474:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406484:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406491:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406497:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406504:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.406508:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406515:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406527:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:0.0:1787781977.406530:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781977.406534:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406552:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904548ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406566:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406571:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406577:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406583:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781977.406585:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406591:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406598:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ef44a9a7900) 00010000:00010000:0.0:1787781977.406600:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781977.406602:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406608:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c904548d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406644:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c904548c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab8 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406655:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab8 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781977.406666:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781977.406669:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787781977.406671:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031800, rc 0) 00000100:00100000:0.0:1787781977.406765:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:10556:x1874625005939328:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 14691us (14879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.406774:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:2.0:1787781977.790006:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023773824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781977.790088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781977.790139:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023773824 00000100:00100000:0.0:1787781977.790147:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023773824 00000100:00100000:0.0:1787781977.790196:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787781977.790203:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874625023773824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787781977.790254:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781977.790306:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874625023773824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781977.790311:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787781977.790429:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023773824:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787781978.366989:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781978.367000:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781978.367056:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787781978.367067:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781978.367280:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023773952:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787781978.367380:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19a80 going to sleep for 11 seconds 00010000:00010000:2.0:1787781978.369199:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781978.379389:0:12115:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781978.379398:0:12115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787781978.379447:0:12115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787781978.379452:0:12115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787781978.379784:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781978.379834:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005939840 00000100:00100000:1.0:1787781978.379842:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005939840 00000100:00100000:1.0:1787781978.379892:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:1.0:1787781978.379903:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:10567:x1874625005939840:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787781978.379937:0:9081:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787781978.380036:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:10567:x1874625005939840:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 134us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781978.380044:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:1.0:1787781978.380199:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023773952:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787781978.413880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781978.413929:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005940096 00000100:00100000:1.0:1787781978.414228:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005940096 00000100:00100000:1.0:1787781978.414303:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:1.0:1787781978.414314:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:10567:x1874625005940096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781978.414335:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781978.414358:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c904548e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dabf expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781978.414462:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904548ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781978.414478:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904548ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781978.414490:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904548ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781978.414502:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787781978.414649:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c904548e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dabf expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781978.414669:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904548ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dabf expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781978.414679:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:1.0:1787781978.414682:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781978.414685:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f200, rc 0) 00000100:00100000:1.0:1787781978.414752:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:10567:x1874625005940096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 440us (881us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787781978.414759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:1.0:1787781978.423304:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781978.424313:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005940224 00000100:00100000:2.0:1787781978.424322:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005940224 00000100:00100000:2.0:1787781978.424447:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:2.0:1787781978.424456:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:2349:x1874625005940224:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781978.424470:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781978.424493:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c904548ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dabf expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781978.424509:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787781978.424513:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781978.424559:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:2349:x1874625005940224:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 105us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781978.424566:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1787781978.455358:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781978.455393:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005940480 00000100:00100000:3.0:1787781978.455402:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005940480 00000100:00100000:3.0:1787781978.455454:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:3.0:1787781978.455464:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:10567:x1874625005940480:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787781978.455538:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781978.455711:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781978.455735:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781978.455977:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781978.455986:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781978.455993:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781978.455999:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781978.458272:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781978.458294:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781978.458313:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:3.0:1787781978.458316:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787781978.458322:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781978.458329:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c904548f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781978.458538:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:10567:x1874625005940480:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 3071us (3184us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787781978.458548:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 132 00000040:00080000:2.0:1787781978.460889:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781978.460899:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781978.461392:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787781978.461402:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787781978.468075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781978.470284:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005940736 00000100:00100000:2.0:1787781978.470298:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005940736 00000100:00100000:2.0:1787781978.470363:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:2.0:1787781978.470374:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:10567:x1874625005940736:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787781978.470615:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:10567:x1874625005940736:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 242us (2548us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787781978.470630:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00010000:00010000:1.0:1787781979.391356:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787781980.327738:0:12166:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781980.327748:0:12166:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787781980.329320:0:12166:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787781980.329330:0:12166:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787781980.416582:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787781980.444898:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787781980.444917:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1787781980.497583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781980.497713:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005940992 00000100:00100000:2.0:1787781980.497726:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005940992 00000100:00100000:2.0:1787781980.497860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:2.0:1787781980.497876:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:10589:x1874625005940992:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781980.497909:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781980.497937:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dac6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781980.498091:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454906 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781980.498112:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781980.498127:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781980.498142:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787781980.498326:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c904548ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dac6 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781980.498347:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dac6 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781980.498358:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787781980.498361:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787781980.498367:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415200, rc 0) 00000100:00100000:2.0:1787781980.498470:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446979a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10589:x1874625005940992:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 600us (900us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787781980.498479:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00080000:1.0:1787781980.498728:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781980.501711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781980.501840:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005941120 00000100:00100000:1.0:1787781980.501854:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005941120 00000100:00100000:0.0:1787781980.502580:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 134 00000100:00100000:0.0:1787781980.502596:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10589:x1874625005941120:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1787781980.502667:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781980.502685:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781980.502704:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781980.502731:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781980.502738:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781980.502745:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781980.502752:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781980.502756:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781980.502763:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781980.502774:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:0.0:1787781980.502777:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787781980.502782:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781980.502819:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781980.502906:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:10589:x1874625005941120:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 314us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781980.502915:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 134 00000100:00100000:0.0:1787781980.601154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781980.601303:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005941248 00000100:00100000:2.0:1787781980.601322:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005941248 00000100:00100000:2.0:1787781980.601436:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:2.0:1787781980.601451:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005941248:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1787781980.601484:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781980.601514:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000239709d2/0x3ad9816c9045491b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dacd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781980.601551:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f6359, atime: 0x6a8f6358, ctime: 0x6a8f6359, blocks: 0xb 00010000:00010000:2.0:1787781980.601581:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1787781980.601587:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781980.601600:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000239709d2/0x3ad9816c9045491b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dacd expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781980.601625:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000239709d2/0x3ad9816c9045491b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dacd expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781980.601643:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414600, rc 0) 00000100:00100000:2.0:1787781980.601736:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2350:x1874625005941248:12345-192.168.202.56@tcp:101:cat.0 Request processed in 290us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781980.601745:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00080000:1.0:1787781980.602073:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787781980.610246:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781980.610451:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005941376 00000100:00100000:1.0:1787781980.610465:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005941376 00002000:00100000:1.0:1787781980.610537:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9ef478a783c0 x1874625005941376/t0(0) o3->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:126/0 lens 488/0 e 0 to 0 dl 1787781991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781980.610551:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef478a783c0 with x1874625005941376 ext(0->4095) 00002000:00010000:1.0:1787781980.610558:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef478a783c0 00000100:00100000:1.0:1787781980.610594:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:1.0:1787781980.610605:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2349:x1874625005941376:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:1.0:1787781980.610942:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2349:x1874625005941376:12345-192.168.202.56@tcp:3:cat.0 Request processed in 338us (710us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787781980.610952:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00002000:00100000:1.0:1787781980.610960:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9ef478a783c0 x1874625005941376/t0(0) o3->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:126/0 lens 488/4536 e 0 to 0 dl 1787781991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781980.610980:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef478a783c0 with x1874625005941376 ext(0->4095) 00002000:00010000:1.0:1787781980.610984:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef478a783c0 00000100:00100000:3.0:1787781981.122575:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781981.122684:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781981.122726:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781981.122866:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005941760 00000100:00100000:1.0:1787781981.122898:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005941760 00000100:00100000:1.0:1787781981.122990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:1.0:1787781981.123004:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005941760:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781981.123115:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005941760:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 114us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781981.123124:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00080000:3.0:1787781981.123818:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781981.123895:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005941632 00000100:00100000:2.0:1787781981.123902:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005941632 00000100:00100000:2.0:1787781981.123967:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:2.0:1787781981.123976:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005941632:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781981.124029:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005941632:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 55us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781981.124036:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00080000:3.0:1787781981.124489:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781981.124636:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005941504 00000100:00100000:0.0:1787781981.124643:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005941504 00000100:00100000:0.0:1787781981.124722:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 290 00000100:00100000:0.0:1787781981.124731:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005941504:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781981.124784:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005941504:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 55us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781981.124812:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 290 00010000:00010000:2.0:1787781981.444456:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781982.398021:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023774080:0@lo:400:kworker.0 00000100:00100000:0.0:1787781982.398093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781982.398189:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023774080 00000100:00100000:1.0:1787781982.398229:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023774080 00000100:00100000:1.0:1787781982.398276:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787781982.398286:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023774080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781982.398503:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023774208:0@lo:400:kworker.0 00000100:00100000:3.0:1787781982.398539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781982.398565:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787781982.398571:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023774336:0@lo:400:kworker.0 00000100:00100000:3.0:1787781982.398591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781982.398617:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023774464:0@lo:400:kworker.0 00000100:00100000:3.0:1787781982.398641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781982.398671:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023774208 00000100:00100000:3.0:1787781982.398675:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023774208 00000100:00100000:3.0:1787781982.398703:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023774336 00000100:00100000:3.0:1787781982.398706:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023774336 00000100:00100000:3.0:1787781982.398734:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787781982.398741:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023774208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781982.398778:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023774208:12345-0@lo:400:kworker.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781982.398804:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787781982.398822:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787781982.398828:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023774336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781982.398856:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023774336:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781982.398877:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1787781982.398905:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781982.398910:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3304:x1874625023774080:12345-0@lo:400:kworker.0 Request processed in 624us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781982.398919:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787781982.398941:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023774336:0@lo:400:kworker.0 00000100:00100000:3.0:1787781982.398954:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023774208:0@lo:400:kworker.0 00000100:00100000:3.0:1787781982.399014:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787781982.399021:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478b36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023774592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787781982.399047:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781982.399079:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023774464 00000100:00100000:3.0:1787781982.399083:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023774464 00000100:00100000:3.0:1787781982.399114:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787781982.399121:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023774464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781982.399156:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023774464:12345-0@lo:400:kworker.0 Request processed in 36us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781982.399163:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787781982.399179:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781982.399212:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787781982.399218:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787781982.399238:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef47f3e5a40, transno 4294967304 00000100:00100000:3.0:1787781982.399254:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b43c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023774464:0@lo:400:kworker.0 00000100:00100000:2.0:1787781982.402387:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781982.402403:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023774720:0@lo:400:kworker.0 00000100:00100000:2.0:1787781982.403494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781982.403554:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023774720 00000100:00100000:2.0:1787781982.403561:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023774720 00000100:00100000:2.0:1787781982.403604:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787781982.403610:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023774720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781982.403646:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023774720:12345-0@lo:400:kworker.0 Request processed in 37us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781982.403651:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787781982.403680:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023774720:0@lo:400:kworker.0 00000100:00080000:2.0:1787781982.403705:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787781982.403724:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023774592 00000100:00100000:2.0:1787781982.403726:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023774592 00000100:00100000:2.0:1787781982.403749:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787781982.403753:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874625023774592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787781982.403775:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781982.403816:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874625023774592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781982.403832:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787781982.403842:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787781982.403861:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478b36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023774592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781982.404585:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023774080:0@lo:400:kworker.0 00000001:00080000:3.0:1787781982.428369:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1787781982.428386:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1787781982.428393:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787781982.429999:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:2.0:1787781982.430012:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef442d189c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787781982.430017:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef446414800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef442d18540 00000020:00080000:2.0:1787781982.430022:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef446414500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef478f90000 00000001:00080000:2.0:1787781982.430043:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:2.0:1787781982.430051:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787781982.430072:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1787781982.430210:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787781982.430374:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787781982.462212:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781982.910512:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781982.910536:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478b34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023774848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787781982.910604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781982.910852:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023774848 00000100:00100000:3.0:1787781982.910861:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023774848 00000100:00100000:3.0:1787781982.910909:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787781982.910920:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023774848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781982.910966:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781982.911017:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023774848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781982.911024:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787781982.911271:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478b34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023774848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787781983.486345:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781984.510095:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781984.638301:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781984.638320:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781984.639727:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787781984.639738:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787781985.480405:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781985.480501:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005941888 00000100:00100000:3.0:1787781985.480512:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005941888 00000100:00100000:3.0:1787781985.480599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:3.0:1787781985.480611:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:10233:x1874625005941888:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787781985.480720:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:10233:x1874625005941888:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 111us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781985.480729:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00080000:2.0:1787781985.481329:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781985.483612:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781985.485822:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005942144 00000100:00100000:0.0:1787781985.485836:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005942144 00000100:00100000:0.0:1787781985.485980:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:0.0:1787781985.485991:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:10233:x1874625005942144:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787781985.486503:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:10233:x1874625005942144:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 512us (2898us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787781985.486512:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00010000:00010000:1.0:1787781985.534034:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781985.652906:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781985.653134:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005942272 00000100:00100000:2.0:1787781985.653154:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005942272 00000100:00100000:2.0:1787781985.653255:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:2.0:1787781985.653266:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:11043:x1874625005942272:12345-192.168.202.56@tcp:101:lsof.0 00010000:00010000:2.0:1787781985.653288:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781985.653310:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dad4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781985.653372:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781985.653402:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781985.653413:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781985.653614:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787781985.653619:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781985.653718:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781985.653742:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dad4 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781985.653759:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dad4 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781985.653768:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:2.0:1787781985.653771:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781985.653775:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415000, rc 0) 00000100:00100000:2.0:1787781985.653882:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:11043:x1874625005942272:12345-192.168.202.56@tcp:101:lsof.0 Request processed in 618us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781985.653891:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00080000:0.0:1787781985.656847:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781986.243109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781986.243176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781986.243206:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781986.243235:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005942528 00000100:00100000:1.0:1787781986.243243:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005942528 00000100:00100000:1.0:1787781986.243304:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005942656 00000100:00100000:1.0:1787781986.243307:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005942656 00000100:00100000:1.0:1787781986.243325:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:1.0:1787781986.243334:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005942528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781986.243394:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:1.0:1787781986.243402:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446978f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005942528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 67us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781986.243411:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:2.0:1787781986.243419:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446978780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005942656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781986.243468:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446978780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005942656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 61us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781986.243498:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:0.0:1787781986.243598:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005942400 00000100:00100000:0.0:1787781986.243603:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005942400 00000100:00100000:0.0:1787781986.243635:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00100000:0.0:1787781986.243642:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2352:x1874625005942400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787781986.243685:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2352:x1874625005942400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 43us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781986.243697:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00080000:0.0:1787781986.243725:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787781986.243728:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787781986.558066:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781987.527061:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023774976:0@lo:400:kworker.0 00000100:00100000:2.0:1787781987.527197:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781987.527243:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787781987.527249:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4469783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023775104:0@lo:400:kworker.0 00000100:00100000:2.0:1787781987.527275:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781987.527302:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023774976 00000100:00100000:2.0:1787781987.527308:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023774976 00000100:00100000:2.0:1787781987.527347:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787781987.527355:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023774976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781987.527401:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023774976:12345-0@lo:400:kworker.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781987.527407:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787781987.527436:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023775104 00000100:00100000:2.0:1787781987.527440:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023775104 00000100:00100000:2.0:1787781987.527466:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787781987.527472:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023775104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781987.527503:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023775104:12345-0@lo:400:kworker.0 Request processed in 30us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781987.527509:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787781987.527543:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4469783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023775104:0@lo:400:kworker.0 00000100:00100000:2.0:1787781987.527551:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023774976:0@lo:400:kworker.0 00000100:00100000:2.0:1787781987.533659:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476aa03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023775360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781987.533855:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446978b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023775232:0@lo:400:kworker.0 00000100:00100000:1.0:1787781987.533894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781987.534198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781987.534302:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023775488:0@lo:400:kworker.0 00000100:00100000:2.0:1787781987.534329:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781987.534361:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023775360 00000100:00100000:2.0:1787781987.534368:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023775360 00000100:00100000:2.0:1787781987.534420:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787781987.534430:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023775360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787781987.534463:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781987.534505:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023775360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781987.534512:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787781987.534534:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023775488 00000100:00100000:2.0:1787781987.534537:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023775488 00000100:00100000:2.0:1787781987.534562:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787781987.534568:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023775488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781987.534598:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b43c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023775488:12345-0@lo:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781987.534605:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787781987.534634:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787781987.534639:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef481b6c780, transno 4294967310 00000004:00080000:2.0:1787781987.534650:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787781987.534672:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476aa03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023775360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787781987.534695:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446979e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023775488:0@lo:400:kworker.0 00000100:00100000:1.0:1787781987.535200:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4469783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023775616:0@lo:400:kworker.0 00000100:00100000:1.0:1787781987.535231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781987.535423:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023775232 00000100:00100000:3.0:1787781987.535428:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023775232 00000100:00100000:3.0:1787781987.535463:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023775616 00000100:00100000:3.0:1787781987.535466:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023775616 00000100:00100000:3.0:1787781987.535488:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787781987.535494:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023775232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781987.535536:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023775232:12345-0@lo:400:kworker.0 Request processed in 42us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781987.535543:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787781987.535556:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787781987.535562:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023775616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781987.535588:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446979e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625023775616:12345-0@lo:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781987.535603:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787781987.535638:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446978b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023775232:0@lo:400:kworker.0 00000100:00100000:3.0:1787781987.535657:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4469783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023775616:0@lo:400:kworker.0 00000100:00080000:0.0:1787781987.535974:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781987.535978:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781987.535981:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787781987.583240:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787781987.583584:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787781987.583597:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787781987.583836:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787781987.583850:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:2.0:1787781987.688570:0:12370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:06:27 (1787781987) 00000100:00100000:2.0:1787781988.031254:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781988.031284:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478b36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023775744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781988.031353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781988.031507:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023775744 00000100:00100000:3.0:1787781988.031515:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023775744 00000100:00100000:3.0:1787781988.031555:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781988.031561:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023775744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781988.031592:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781988.031648:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023775744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781988.031655:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787781988.031752:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478b36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023775744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787781988.606023:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781989.405468:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781989.405521:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005942912 00000100:00100000:3.0:1787781989.405531:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005942912 00000100:00080000:0.0:1787781989.405641:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787781989.405676:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:3.0:1787781989.405688:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:11307:x1874625005942912:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781989.405714:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781989.405742:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454930 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dadb expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.405853:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.405867:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.405882:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.405911:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.405918:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.405926:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406455:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454945 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406466:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454945 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406473:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454945 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781989.406483:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787781989.406687:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406696:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406703:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406709:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781989.406713:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406731:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406743:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef44a9a7800) 00010000:00010000:3.0:1787781989.406746:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781989.406751:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406758:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454937 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406772:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406779:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406785:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406840:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781989.406843:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406848:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406855:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ef44a7db600) 00010000:00010000:3.0:1787781989.406858:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781989.406860:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.406875:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c9045493e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.407263:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454930 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dadb expref: 16 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.407277:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454945 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dadb expref: 15 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781989.407285:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:3.0:1787781989.407287:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781989.407289:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2800, rc 0) 00000100:00100000:3.0:1787781989.407358:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:11307:x1874625005942912:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1673us (1900us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787781989.407368:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:2.0:1787781989.420190:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781989.420227:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781989.420492:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005943040 00000100:00100000:0.0:1787781989.420503:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005943040 00000100:00100000:0.0:1787781989.420569:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:0.0:1787781989.420581:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:11307:x1874625005943040:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787781989.420706:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:11307:x1874625005943040:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 127us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781989.420715:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:1.0:1787781989.420783:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005943168 00000100:00100000:1.0:1787781989.420832:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005943168 00000100:00100000:1.0:1787781989.420869:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1787781989.420876:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:2352:x1874625005943168:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781989.420889:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781989.420915:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454945 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dadb expref: 15 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781989.420934:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:1.0:1787781989.420939:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781989.420959:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:2352:x1874625005943168:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 84us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781989.420978:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00010000:00010000:3.0:1787781989.630265:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781989.759001:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781989.759012:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781989.759501:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787781989.759511:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787781990.654147:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781991.128219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781991.128330:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005943296 00000100:00100000:2.0:1787781991.128343:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005943296 00000100:00100000:2.0:1787781991.128444:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:2.0:1787781991.128457:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446978b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:11350:x1874625005943296:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781991.128485:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787781991.128503:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787781991.128513:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454953 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dae2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.128603:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.128622:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.128636:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.128653:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.128672:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.128679:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129242:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129254:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129261:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129268:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781991.129274:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129282:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129298:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:2.0:1787781991.129302:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781991.129307:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129314:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c9045495a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129328:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129340:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129346:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129351:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781991.129354:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129361:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129370:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ef45088a300) 00010000:00010000:2.0:1787781991.129373:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781991.129376:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129383:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454961 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129425:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454953 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dae2 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129438:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:2.0:1787781991.129440:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781991.129444:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dae2 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.129453:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414400, rc 0) 00000100:00100000:2.0:1787781991.129554:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446978b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:11350:x1874625005943296:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1098us (1357us total) trans 0 rc 301/301 00000100:00100000:2.0:1787781991.129564:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:3.0:1787781991.138302:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781991.138591:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005943552 00000100:00100000:2.0:1787781991.138605:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005943552 00000100:00100000:2.0:1787781991.138670:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 140 00000100:00100000:2.0:1787781991.138682:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:11350:x1874625005943552:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1787781991.138878:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781991.138923:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c904542d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d91b expref: 14 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.138943:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:2.0:1787781991.138949:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781991.143993:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.144107:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dad4 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.144145:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.144214:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dad4 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.144233:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dad4 expref: 5 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781991.144252:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef481b6c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023775872:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781991.144511:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4412ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1787781991.150159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781991.150308:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005943680 00000100:00100000:2.0:1787781991.150321:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005943680 00010000:00010000:2.0:1787781991.150398:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dad4 expref: 6 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781991.150439:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:2.0:1787781991.150452:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b35e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:2351:x1874625005943680:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781991.150473:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781991.150481:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dad4 expref: 6 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.150497:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dad4 expref: 6 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.150541:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:2.0:1787781991.150547:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.150558:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.150567:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.150592:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781991.150661:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b35e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:2351:x1874625005943680:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 211us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781991.150669:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00080000:3.0:1787781991.150870:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787781991.152750:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454929 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dad4 expref: 5 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781991.152784:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef481b6c780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023775872:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787781991.153151:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.153164:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.153193:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.153228:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.153244:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.153256:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.155428:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787781991.155451:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.155463:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.155471:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.155479:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781991.155484:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.155493:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.155514:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef44a7db300) 00010000:00010000:1.0:1787781991.155518:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781991.155533:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.155539:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454968 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781991.155564:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aff6da0b reply state 000000001a60c3ca transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781991.155574:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787781991.156306:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:11350:x1874625005943552:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 17617us (18019us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787781991.156317:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 140 00010000:00010000:2.0:1787781991.162821:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.162840:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.162846:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.162851:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781991.162855:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.162863:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.162902:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ef448467e00) 00010000:00010000:2.0:1787781991.162906:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781991.162912:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.162920:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c9045496f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781991.319335:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781991.319476:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005943808 00000100:00100000:1.0:1787781991.319491:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005943808 00000100:00100000:1.0:1787781991.319582:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 141 00000100:00100000:1.0:1787781991.319595:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:11358:x1874625005943808:12345-192.168.202.56@tcp:101:lctl.0 00010000:00010000:1.0:1787781991.319628:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.319660:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454976 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dae9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.319762:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f000/0x3ad9816c9045497d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.319780:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f000/0x3ad9816c9045497d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.319854:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f000/0x3ad9816c9045497d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.319941:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787781991.319963:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787781991.320015:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f000/0x3ad9816c9045497d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.320047:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454976 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dae9 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.320069:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f000/0x3ad9816c9045497d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dae9 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.320090:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467200) 00010000:00010000:1.0:1787781991.320101:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787781991.320106:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f000, rc 0) 00000100:00100000:1.0:1787781991.320200:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:11358:x1874625005943808:12345-192.168.202.56@tcp:101:lctl.0 Request processed in 607us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.320209:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 141 00000100:00100000:3.0:1787781991.366089:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781991.366274:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005943936 00000100:00100000:1.0:1787781991.366299:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005943936 00000100:00100000:1.0:1787781991.366385:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:1.0:1787781991.366399:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2352:x1874625005943936:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787781991.366496:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2352:x1874625005943936:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 101us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.366504:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:0.0:1787781991.366745:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781991.366930:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781991.367335:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005944192 00000100:00100000:3.0:1787781991.367342:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005944192 00000100:00100000:3.0:1787781991.367399:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005944064 00000100:00100000:3.0:1787781991.367402:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005944064 00000100:00100000:3.0:1787781991.367423:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:3.0:1787781991.367431:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47914b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005944192:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781991.367508:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47914b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005944192:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781991.367515:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:3.0:1787781991.367529:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:3.0:1787781991.367535:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47914a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005944064:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781991.367556:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47914a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005944064:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781991.367562:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00080000:0.0:1787781991.367984:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787781991.368373:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781991.418844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781991.419013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005944320 00000100:00100000:1.0:1787781991.419027:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005944320 00000100:00100000:1.0:1787781991.419469:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:1.0:1787781991.419484:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47914a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+15:11364:x1874625005944320:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1787781991.419512:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.419560:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140daf0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.419650:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.419668:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.419683:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.419702:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.419710:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.419718:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.419907:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.419916:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.419923:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.419962:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787781991.419967:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787781991.420243:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420271:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420279:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420285:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420349:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781991.420356:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420364:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420380:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467200) 00010000:00010000:1.0:1787781991.420384:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781991.420389:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420396:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c9045498b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420412:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420417:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420422:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420435:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781991.420438:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420443:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420451:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ef448467100) 00010000:00010000:1.0:1787781991.420453:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781991.420456:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420461:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454992 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420502:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf0 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420518:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf0 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.420527:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781991.420530:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787781991.420532:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e200, rc 0) 00000100:00100000:1.0:1787781991.420622:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47914a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:11364:x1874625005944320:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1142us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.420637:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:2.0:1787781991.425606:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781991.425702:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005944576 00000100:00100000:1.0:1787781991.425733:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005944576 00000100:00100000:1.0:1787781991.425825:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:1.0:1787781991.425837:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:11364:x1874625005944576:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1787781991.425865:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.425893:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c904549a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140daf7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.426425:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.426445:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.426460:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.426625:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.426649:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.426663:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787781991.430347:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787781991.430649:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.430667:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.430699:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.430738:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.430746:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.430754:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.430760:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781991.430765:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.430773:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.430828:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781991.430833:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781991.430838:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.436170:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781991.436195:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007895b38f reply state 00000000bde5b0b1 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781991.436204:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787781991.436285:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c904549a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf7 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.436301:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf7 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.436310:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef448467300) 00010000:00010000:1.0:1787781991.436313:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781991.436317:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183fe00, rc 0) 00000100:00100000:1.0:1787781991.436414:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11364:x1874625005944576:12345-192.168.202.56@tcp:101:bash.0 Request processed in 10579us (10822us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787781991.436424:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 143 00010000:00010000:1.0:1787781991.443919:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.443943:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.443952:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.443970:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781991.443976:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.443986:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.444016:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef448467500) 00010000:00010000:1.0:1787781991.444020:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781991.444047:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.444054:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781991.448161:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781991.448873:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005944704 00000100:00100000:3.0:1787781991.448889:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005944704 00000100:00100000:3.0:1787781991.448981:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:3.0:1787781991.448993:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2352:x1874625005944704:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1787781991.449017:0:8308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781991.449045:0:8308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dafe expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787781991.449091:0:8308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787781991.449128:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1787781991.449134:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781991.449147:0:8308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dafe expref: 6 pid: 8308 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.449171:0:8308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dafe expref: 6 pid: 8308 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.449213:0:8308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3c00, rc 0) 00000100:00100000:3.0:1787781991.449711:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2352:x1874625005944704:12345-192.168.202.56@tcp:101:bash.0 Request processed in 718us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781991.449720:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:3.0:1787781991.461537:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781991.464317:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005944832 00000100:00100000:2.0:1787781991.464340:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005944832 00000100:00100000:2.0:1787781991.464443:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1787781991.464455:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b36580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:11364:x1874625005944832:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781991.464491:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781991.464519:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db05 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.464560:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dafe expref: 7 pid: 8308 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.464571:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781991.464576:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781991.464583:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.464654:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dafe expref: 7 pid: 8308 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.464673:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dafe expref: 7 pid: 8308 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781991.464689:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874625023776000:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781991.464873:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a000 going to sleep for 11 seconds 00000100:00100000:0.0:1787781991.474982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781991.475098:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005944960 00000100:00100000:1.0:1787781991.475110:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005944960 00010000:00010000:1.0:1787781991.475174:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dafe expref: 8 pid: 8308 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781991.475226:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:1.0:1787781991.475238:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479149a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005944960:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781991.475258:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781991.475287:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dafe expref: 8 pid: 8308 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.475305:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dafe expref: 8 pid: 8308 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.475339:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781991.475344:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781991.475355:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.475382:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.475466:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781991.475596:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef481b6c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1874625023776128:192.168.202.56@tcp:105: 00000100:00100000:1.0:1787781991.475708:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963c00 going to sleep for 11 seconds 00010000:00010000:2.0:1787781991.475999:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c904549c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dafe expref: 8 pid: 8308 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781991.476016:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef446938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1874625023776000:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781991.476045:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.476057:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414a00, rc 0) 00000100:00100000:2.0:1787781991.476102:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b36580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:11364:x1874625005944832:12345-192.168.202.56@tcp:101:bash.0 Request processed in 11649us (14580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781991.476111:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:1.0:1787781991.482014:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef481b6c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1874625023776128:192.168.202.56@tcp:105: 00010000:00010000:1.0:1787781991.482055:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781991.482153:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479149a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005944960:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6916us (7185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781991.482168:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:3.0:1787781991.482927:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781991.483818:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005945216 00000100:00100000:2.0:1787781991.483832:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005945216 00000100:00100000:2.0:1787781991.483898:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:2.0:1787781991.483909:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:11364:x1874625005945216:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:2.0:1787781991.484447:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11364:x1874625005945216:12345-192.168.202.56@tcp:35:bash.0 Request processed in 535us (1522us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787781991.484456:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:0.0:1787781991.648098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781991.648319:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005945472 00000100:00100000:1.0:1787781991.648330:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005945472 00000100:00100000:1.0:1787781991.648415:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:1.0:1787781991.648432:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11374:x1874625005945472:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781991.648464:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.648502:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db0c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.648645:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787781991.648779:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db0c expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.648838:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467200) 00010000:00010000:1.0:1787781991.648842:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781991.648868:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c904549d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db0c expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.648886:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e600, rc 0) 00000100:00100000:1.0:1787781991.648961:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479148b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:11374:x1874625005945472:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 531us (879us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787781991.648969:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:3.0:1787781991.655784:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781991.656258:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005945728 00000100:00100000:2.0:1787781991.656272:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005945728 00000100:00100000:2.0:1787781991.656358:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:2.0:1787781991.656370:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:11374:x1874625005945728:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781991.656713:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:11374:x1874625005945728:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 344us (947us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787781991.656723:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00010000:00010000:1.0:1787781991.678435:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781991.771954:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781991.772539:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005945856 00000100:00100000:3.0:1787781991.772554:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005945856 00000100:00100000:3.0:1787781991.772641:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:3.0:1787781991.772653:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:11380:x1874625005945856:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781991.772689:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781991.772721:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c904549df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db13 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.772854:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c904549e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.772871:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c904549e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.772884:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c904549e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781991.772962:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787781991.772967:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781991.773243:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c904549e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.773308:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c904549df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db13 expref: 23 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.773330:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c904549e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db13 expref: 22 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.773339:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:3.0:1787781991.773343:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781991.773347:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3600, rc 0) 00000100:00100000:3.0:1787781991.773435:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:11380:x1874625005945856:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 784us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781991.773443:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:0.0:1787781991.777866:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781991.778033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005946112 00000100:00100000:1.0:1787781991.778045:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005946112 00000100:00100000:1.0:1787781991.778145:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 146 00000100:00100000:1.0:1787781991.778157:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:11380:x1874625005946112:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781991.778184:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.778209:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c904549ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db1a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.778730:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.778751:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.778766:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.778779:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787781991.778982:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c904549ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db1a expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.779169:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db1a expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.779179:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef448467300) 00010000:00010000:1.0:1787781991.779182:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781991.779186:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e400, rc 0) 00000100:00100000:1.0:1787781991.779267:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11380:x1874625005946112:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1113us (1414us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787781991.779277:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 146 00000100:00100000:2.0:1787781991.784050:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781991.784130:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781991.785544:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005946368 00000100:00100000:0.0:1787781991.785562:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005946368 00000100:00100000:0.0:1787781991.785666:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:0.0:1787781991.785679:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:2349:x1874625005946368:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781991.785720:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781991.785756:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904549f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db1a expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.785783:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef448467300) 00010000:00010000:0.0:1787781991.785842:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781991.785919:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:2349:x1874625005946368:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 242us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781991.785928:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:1.0:1787781991.786512:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005946496 00000100:00100000:1.0:1787781991.786520:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005946496 00000100:00100000:1.0:1787781991.786566:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 147 00000100:00100000:1.0:1787781991.786575:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:11380:x1874625005946496:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781991.786604:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781991.786625:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454a02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db21 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.786759:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.786778:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.786823:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781991.786837:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787781991.787001:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454a02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db21 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.787020:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db21 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.787029:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef448467300) 00010000:00010000:1.0:1787781991.787031:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787781991.787034:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183ea00, rc 0) 00000100:00100000:1.0:1787781991.787749:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:11380:x1874625005946496:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1169us (3611us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787781991.787759:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 147 00000100:00100000:2.0:1787781991.800173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781991.800453:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005946624 00000100:00100000:3.0:1787781991.800468:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005946624 00000100:00100000:3.0:1787781991.800538:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1787781991.800549:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2350:x1874625005946624:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:3.0:1787781991.800607:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.800633:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.800643:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781991.800648:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781991.800653:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.800721:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.800736:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 6 pid: 6694 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781991.800754:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874625023776256:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781991.800899:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47675c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787781991.810657:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781991.810872:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005946752 00000100:00100000:1.0:1787781991.810884:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005946752 00002000:00100000:1.0:1787781991.810965:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ef47914bc00 x1874625005946752/t0(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:137/0 lens 504/0 e 0 to 0 dl 1787782002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781991.810978:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef47914bc00 with x1874625005946752 ext(0->12) 00010000:00010000:1.0:1787781991.810997:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 7 pid: 6694 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.811017:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 7 pid: 6694 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787781991.811025:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ef47914bc00 00000100:00100000:1.0:1787781991.811062:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1787781991.811074:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47914bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005946752:12345-192.168.202.56@tcp:4:lfs.0 00000100:00100000:3.0:1787781991.811614:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874625023776256:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781991.811649:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781991.813921:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47914bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2352:x1874625005946752:12345-192.168.202.56@tcp:4:lfs.0 Request processed in 2834us (3265us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787781991.813949:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00002000:00100000:1.0:1787781991.813977:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ef47914bc00 x1874625005946752/t4294967305(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:137/0 lens 504/448 e 0 to 0 dl 1787782002 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787781991.815618:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef47914bc00 with x1874625005946752 ext(0->12) 00010000:00010000:1.0:1787781991.815645:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 9 pid: 6694 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781991.815668:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 9 pid: 6694 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787781991.815677:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ef47914bc00 00000100:00100000:0.0:1787781991.818730:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781991.822484:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005946880 00000100:00100000:2.0:1787781991.822504:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005946880 00010000:00010000:2.0:1787781991.822574:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 9 pid: 6694 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781991.822634:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:2.0:1787781991.822647:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47914b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2349:x1874625005946880:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781991.822668:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787781991.822694:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787781991.822698:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787781992 00002000:00010000:2.0:1787781991.822701:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787781992 00002000:00010000:2.0:1787781991.822703:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787781992 00010000:00010000:2.0:1787781991.822730:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 9 pid: 6694 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.822748:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 9 pid: 6694 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.822779:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f67c78f/0x3ad9816c904549ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db05 expref: 9 pid: 6694 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.822847:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781991.822853:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781991.822861:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.822873:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.822979:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781991.823052:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47914b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2349:x1874625005946880:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 408us (4336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781991.823060:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00010000:00010000:3.0:1787781991.834411:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.834438:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.834490:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.834498:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.834535:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.834544:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781991.834549:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.834558:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.834582:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.834591:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c90454a17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781991.834747:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2350:x1874625005946624:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 34192us (34579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781991.834760:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:0.0:1787781991.838852:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781991.841422:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005947136 00000100:00100000:2.0:1787781991.841445:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005947136 00000100:00100000:2.0:1787781991.841547:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:2.0:1787781991.841559:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:11380:x1874625005947136:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:2.0:1787781991.841653:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db21 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781991.842066:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787781991.842266:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787781991.842926:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787781991.843000:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.843023:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf7 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.843034:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.843103:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf7 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781991.843130:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf7 expref: 29 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781991.843149:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1874625023776384:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781991.843290:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781991.847785:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781991.847920:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005947264 00000100:00100000:0.0:1787781991.847933:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005947264 00000100:00100000:3.0:1787781991.847977:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1874625023776384:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781991.847998:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf7 expref: 30 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.848014:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781991.848059:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:0.0:1787781991.848070:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:2351:x1874625005947264:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781991.848105:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781991.848123:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf7 expref: 30 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.848137:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf7 expref: 30 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.848166:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c904549b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf7 expref: 30 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.848203:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef448467300) 00010000:00010000:0.0:1787781991.848209:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.848220:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.848230:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.848266:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781991.848353:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:2351:x1874625005947264:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 283us (584us total) trans 0 rc 0/0 00010000:00010000:3.0:1787781991.848358:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781991.848364:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00010000:00010000:3.0:1787781991.848383:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787781991.848562:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787781991.849494:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787781991.849662:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874625023776512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787781991.849872:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781991.849912:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448ea7180 going to sleep for 11 seconds 00000100:00100000:2.0:1787781991.850104:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023776512 00000100:00100000:2.0:1787781991.850121:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023776512 00000100:00100000:2.0:1787781991.850197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787781991.850208:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781991.850209:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874625023776512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787781991.850322:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874625023776512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781991.850347:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787781991.850429:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874625023776512:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787781991.853936:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787781991.854369:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479149a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874625023776640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787781991.854466:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781991.854515:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef45213ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781991.854595:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023776640 00000100:00100000:1.0:1787781991.854606:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023776640 00000100:00100000:1.0:1787781991.854676:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787781991.854686:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47914b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1874625023776640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787781991.854984:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47914b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1874625023776640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 297us (516us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787781991.854993:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787781991.855472:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479149a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874625023776640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787781991.855561:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787781991.855620:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.855633:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.855642:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.855665:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781991.855671:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.855680:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.855699:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef448467300) 00010000:00010000:0.0:1787781991.855702:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787781991.855708:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781991.855715:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454a1e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787781991.856011:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787781991.856579:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1787781991.856595:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359634805297ns, next at 360634801857ns, rc = 0 00000001:00080000:0.0:1787781991.856604:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787781991.856656:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef448467300) 00010000:00010000:0.0:1787781991.856659:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787781991.856670:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db21 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781991.857598:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11380:x1874625005947136:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 16033us (18755us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787781991.857612:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00000020:00080000:0.0:1787781991.857620:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787781991.861691:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781991.862307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005947392 00000100:00100000:3.0:1787781991.862320:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005947392 00000100:00100000:3.0:1787781991.862429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 148 00000100:00100000:3.0:1787781991.862442:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11380:x1874625005947392:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781991.862477:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781991.862508:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454a25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db28 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.862592:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454a25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db28 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.862610:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454a25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db28 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781991.862635:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:3.0:1787781991.862639:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781991.862643:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2200, rc 0) 00000100:00100000:3.0:1787781991.862743:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:11380:x1874625005947392:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 302us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781991.862751:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 148 00000100:00100000:1.0:1787781991.867306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781991.867409:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005947648 00000100:00100000:0.0:1787781991.867421:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005947648 00000100:00100000:0.0:1787781991.867486:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:0.0:1787781991.867497:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:11380:x1874625005947648:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1787781991.867819:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:11380:x1874625005947648:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 290us (752us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787781991.867828:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:2.0:1787781992.027458:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781992.027600:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005947904 00000100:00100000:3.0:1787781992.027611:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005947904 00000100:00100000:3.0:1787781992.027678:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 149 00000100:00100000:3.0:1787781992.027689:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:11390:x1874625005947904:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781992.027725:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781992.027763:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454a2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db2f expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781992.028315:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787781992.030717:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454a2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db2f expref: 36 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.030755:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467200) 00010000:00010000:3.0:1787781992.030760:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781992.030767:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454a2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db2f expref: 36 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.030924:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3400, rc 0) 00000100:00100000:3.0:1787781992.031268:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:11390:x1874625005947904:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3577us (3829us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787781992.031280:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 149 00000100:00100000:3.0:1787781992.037186:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781992.038529:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005948032 00000100:00100000:1.0:1787781992.038548:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005948032 00000100:00100000:1.0:1787781992.038635:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 150 00000100:00100000:1.0:1787781992.038646:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:11390:x1874625005948032:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:1.0:1787781992.038763:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.038858:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.038873:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.038896:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.038903:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.038910:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.039053:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.039063:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.039070:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781992.040341:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040369:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040375:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040401:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040406:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781992.040410:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040565:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040581:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781992.040584:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781992.040588:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040593:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040607:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040612:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040615:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040618:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781992.040620:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040631:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040637:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef448467500) 00010000:00010000:1.0:1787781992.040638:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781992.040640:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040643:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040656:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040660:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040664:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040667:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781992.040668:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040671:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040677:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781992.040679:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781992.040681:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.040696:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.042415:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:11390:x1874625005948032:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 3754us (5232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.042443:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 150 00000100:00100000:1.0:1787781992.046298:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781992.046554:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005948288 00000100:00100000:2.0:1787781992.046569:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005948288 00000100:00100000:2.0:1787781992.046652:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:2.0:1787781992.046664:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:11390:x1874625005948288:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1787781992.049379:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:11390:x1874625005948288:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 2701us (3079us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787781992.049396:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:0.0:1787781992.163540:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781992.163981:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005948544 00000100:00100000:1.0:1787781992.163995:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005948544 00000100:00100000:1.0:1787781992.164083:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 151 00000100:00100000:1.0:1787781992.164096:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47914ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:11393:x1874625005948544:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781992.164142:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781992.164170:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db36 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.164289:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.164308:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.164323:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.164339:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.164348:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.164378:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.165295:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.165311:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.165322:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781992.165336:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787781992.166177:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166194:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166202:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166210:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781992.166215:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166329:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166347:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781992.166350:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781992.166373:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166381:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166399:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166406:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166412:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166418:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781992.166421:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166427:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166434:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef448467500) 00010000:00010000:1.0:1787781992.166436:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781992.166439:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166445:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166616:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454a4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db36 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166644:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db36 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.166652:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781992.166655:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781992.166657:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183ee00, rc 0) 00000100:00100000:1.0:1787781992.167101:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47914ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:11393:x1874625005948544:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2946us (3515us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787781992.167419:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 151 00000100:00100000:0.0:1787781992.184054:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781992.184279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005948672 00000100:00100000:3.0:1787781992.184292:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005948672 00000100:00100000:3.0:1787781992.184393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 152 00000100:00100000:3.0:1787781992.184406:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:11393:x1874625005948672:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1787781992.184529:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.184552:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.184566:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.184601:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.184609:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.184617:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.184624:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781992.184629:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.184638:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.184653:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:3.0:1787781992.184657:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781992.184662:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.184693:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.184814:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479148f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:11393:x1874625005948672:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 385us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.184823:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 152 00000100:00100000:0.0:1787781992.188432:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781992.188780:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005948928 00000100:00100000:3.0:1787781992.188828:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005948928 00000100:00100000:3.0:1787781992.188892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:3.0:1787781992.188903:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:11393:x1874625005948928:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1787781992.189693:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+39:11393:x1874625005948928:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 786us (1279us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787781992.189704:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:0.0:1787781992.519079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781992.519282:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005949184 00000100:00100000:3.0:1787781992.519296:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005949184 00000100:00100000:3.0:1787781992.519384:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 153 00000100:00100000:3.0:1787781992.519396:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47914b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+39:11424:x1874625005949184:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1787781992.519431:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781992.519888:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db3d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.520052:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.520071:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.520125:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781992.520142:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787781992.520348:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454a79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db3d expref: 42 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.520373:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db3d expref: 41 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.520383:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:3.0:1787781992.520386:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781992.520390:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3400, rc 0) 00000100:00100000:3.0:1787781992.520481:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47914b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+41:11424:x1874625005949184:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1086us (1417us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787781992.520491:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 153 00000100:00100000:1.0:1787781992.524491:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781992.524528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781992.524652:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005949568 00000100:00100000:3.0:1787781992.524664:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005949568 00000100:00100000:3.0:1787781992.524741:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:3.0:1787781992.524749:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+41:2352:x1874625005949568:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781992.524766:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781992.524825:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db3d expref: 41 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.524845:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:3.0:1787781992.524858:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781992.524943:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+40:2352:x1874625005949568:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 195us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.524961:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:0.0:1787781992.525470:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005949440 00000100:00100000:0.0:1787781992.525478:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005949440 00000100:00100000:0.0:1787781992.525519:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:0.0:1787781992.525525:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+40:11424:x1874625005949440:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:0.0:1787781992.525766:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+41:11424:x1874625005949440:12345-192.168.202.56@tcp:35:cat.0 Request processed in 242us (1289us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787781992.525772:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:0.0:1787781992.569760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781992.569840:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005949824 00000100:00100000:3.0:1787781992.569856:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005949824 00000100:00100000:1.0:1787781992.570072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:1.0:1787781992.570087:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479149e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+41:11430:x1874625005949824:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:1.0:1787781992.570133:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781992.570137:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787781992.570176:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c904549e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db13 expref: 41 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.570202:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781992.570208:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781992.570231:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db44 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.570372:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.570410:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db36 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.570419:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.570491:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db36 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.570508:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db36 expref: 41 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.570525:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f554f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023776768:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781992.570649:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963600 going to sleep for 11 seconds 00000100:00100000:0.0:1787781992.574236:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781992.574496:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005949952 00000100:00100000:2.0:1787781992.574508:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005949952 00010000:00010000:2.0:1787781992.574575:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db36 expref: 42 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781992.574628:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:2.0:1787781992.574640:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+42:2352:x1874625005949952:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781992.574661:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781992.574669:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db36 expref: 42 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.574685:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db36 expref: 42 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.574713:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:2.0:1787781992.574719:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.574731:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.574765:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.574823:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781992.574886:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+42:2352:x1874625005949952:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 247us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781992.574894:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00010000:00010000:1.0:1787781992.579605:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454a64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db36 expref: 41 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.579643:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f554f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023776768:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787781992.579679:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.579694:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.579700:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781992.579731:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787781992.580263:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454a8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db44 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.580282:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db44 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.580293:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781992.580297:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787781992.580300:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e800, rc 0) 00000100:00100000:1.0:1787781992.580399:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479149e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+41:11430:x1874625005949824:12345-192.168.202.56@tcp:101:dd.0 Request processed in 10315us (10655us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787781992.580410:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:0.0:1787781992.584007:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781992.584127:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005950208 00000100:00100000:2.0:1787781992.584140:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005950208 00000100:00100000:2.0:1787781992.584215:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:2.0:1787781992.584227:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47914a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+41:11430:x1874625005950208:12345-192.168.202.56@tcp:36:dd.0 00010000:00010000:2.0:1787781992.584598:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.584625:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.584641:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781992.584709:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787781992.584735:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016903771 reply state 00000000064a3de1 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781992.584747:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781992.584891:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47914a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+44:11430:x1874625005950208:12345-192.168.202.56@tcp:36:dd.0 Request processed in 664us (901us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787781992.584900:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 155 00000020:00080000:2.0:1787781992.584907:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787781992.588276:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.588299:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.588308:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.588315:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781992.588321:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.588331:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.588353:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:2.0:1787781992.588357:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781992.588363:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.588370:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454aa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781992.639334:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f499e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023776896:0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.639388:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f49b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023777152:0@lo:400:kworker.0 00000100:00100000:3.0:1787781992.640878:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023777280:0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.640977:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023777024:0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.641035:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781992.641092:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023777536:0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.641132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781992.641198:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023777536 00000100:00100000:1.0:1787781992.641208:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023777536 00000100:00100000:1.0:1787781992.641284:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787781992.641295:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f554780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023777536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.641359:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f554780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023777536:12345-0@lo:400:kworker.0 Request processed in 66us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.641368:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787781992.641420:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023777536:0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.641453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781992.641510:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023777024 00000100:00100000:1.0:1787781992.641515:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023777024 00000100:00100000:1.0:1787781992.641543:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023777152 00000100:00100000:1.0:1787781992.641547:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023777152 00000100:00100000:1.0:1787781992.641569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787781992.641576:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023777024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.641616:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023777024:12345-0@lo:400:kworker.0 Request processed in 40us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.641622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787781992.641635:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787781992.641641:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f5570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023777152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.641675:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f5570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023777152:12345-0@lo:400:kworker.0 Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.641681:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787781992.641706:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f499a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023777024:0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.641732:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f49b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023777152:0@lo:400:kworker.0 00000100:00080000:0.0:1787781992.643924:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787781992.643939:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787781992.644082:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023777664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781992.644191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781992.644280:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023777664 00000100:00100000:0.0:1787781992.644290:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023777664 00000100:00100000:0.0:1787781992.644347:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787781992.644357:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023777664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787781992.644401:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787781992.644451:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023777664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781992.644458:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787781992.644768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781992.645721:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023777664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787781992.645785:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023776896 00000100:00100000:1.0:1787781992.645828:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023776896 00000100:00100000:1.0:1787781992.645873:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787781992.645882:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023776896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.645961:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023776896:12345-0@lo:400:kworker.0 Request processed in 81us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.645969:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787781992.646062:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f499e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023776896:0@lo:400:kworker.0 00000100:00100000:2.0:1787781992.646075:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023777408:0@lo:400:kworker.0 00000100:00100000:2.0:1787781992.646125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781992.646516:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023777408 00000100:00100000:1.0:1787781992.646520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023777408 00000100:00100000:1.0:1787781992.646581:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787781992.646587:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023777408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787781992.646632:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625023777408:12345-0@lo:400:kworker.0 Request processed in 45us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.646639:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787781992.646733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781992.646775:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023777280 00000100:00100000:3.0:1787781992.646779:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023777280 00000100:00100000:3.0:1787781992.646836:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781992.646844:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625023777280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787781992.646879:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625023777280:12345-0@lo:400:kworker.0 Request processed in 36us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.646885:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787781992.646931:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023777280:0@lo:400:kworker.0 00000100:00080000:0.0:1787781992.648137:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787781992.651165:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023777408:0@lo:400:kworker.0 00000001:00080000:3.0:1787781992.682734:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000004:00080000:3.0:1787781992.682761:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787781992.682785:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef448ea7540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787781992.682807:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef47fae7300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef448ea7180 00000020:00080000:3.0:1787781992.682811:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef47fae7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef4460d7800 00000020:00080000:0.0:1787781992.682880:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787781992.683462:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787781992.684121:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781992.684149:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023777792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787781992.684351:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781992.684555:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023777792 00000100:00100000:2.0:1787781992.684581:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023777792 00000100:00100000:2.0:1787781992.684641:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787781992.684651:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625023777792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787781992.684684:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1787781992.684723:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f6368, atime: 0x6a8f6368, ctime: 0x6a8f6368, blocks: 0x1 00010000:00010000:2.0:1787781992.684732:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.684753:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1787781992.684757:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781992.684765:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.684784:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.684830:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.684838:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.684855:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787781992.685039:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781992.685048:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.685066:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781992.685071:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.685091:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.685122:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.685130:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee4ca290/0x3ad9816c90454aaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.685155:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781992.685157:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781992.685159:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781992.687400:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874625023777792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2740us (3039us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787781992.687415:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1787781992.687869:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef476bb4b40/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787781992.687879:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023777792:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787781992.688016:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000001:00080000:2.0:1787781992.688384:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00010000:00010000:1.0:1787781992.702283:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781992.836816:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781992.836901:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005950336 00000100:00100000:1.0:1787781992.836912:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005950336 00000100:00100000:1.0:1787781992.836990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 156 00000100:00100000:1.0:1787781992.836999:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479149680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+16:11444:x1874625005950336:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:1.0:1787781992.837030:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781992.837055:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837153:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837172:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837187:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837208:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837216:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837249:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837660:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837673:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db44 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837683:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837726:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db44 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.837744:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db44 expref: 17 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.837762:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f555e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023777920:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781992.838814:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963900 going to sleep for 11 seconds 00000100:00100000:1.0:1787781992.841037:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781992.841139:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005950592 00000100:00100000:2.0:1787781992.841199:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f555e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023777920:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781992.841236:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781992.841366:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005950592 00000100:00100000:0.0:1787781992.841430:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:0.0:1787781992.841441:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f5543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:5586:x1874625005950592:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787781992.841965:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f5543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:5586:x1874625005950592:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 523us (937us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787781992.841975:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:0.0:1787781992.843726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781992.843820:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005950720 00000100:00100000:3.0:1787781992.843831:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005950720 00010000:00010000:3.0:1787781992.843880:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db44 expref: 19 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781992.843909:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:3.0:1787781992.843916:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462058780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:2351:x1874625005950720:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781992.843930:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781992.843936:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db44 expref: 19 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.843948:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db44 expref: 19 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.844126:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454a95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db44 expref: 19 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.844145:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:3.0:1787781992.844151:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.844162:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.844172:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.844209:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781992.844389:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844398:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781992.844460:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787781992.844467:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781992.844494:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844511:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844523:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844530:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844537:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844544:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781992.844548:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844556:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844577:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781992.844579:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781992.844584:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844591:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844603:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844609:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844616:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844621:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781992.844624:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844630:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844638:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef448467500) 00010000:00010000:2.0:1787781992.844640:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781992.844643:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844649:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844710:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db4b expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844727:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db4b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781992.844735:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:2.0:1787781992.844737:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781992.844740:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f200, rc 0) 00000100:00100000:3.0:1787781992.844856:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462058780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:2351:x1874625005950720:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 937us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781992.844867:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:2.0:1787781992.845140:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479149680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:11444:x1874625005950336:12345-192.168.202.56@tcp:101:stat.0 Request processed in 8141us (8362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781992.845149:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 156 00000100:00100000:2.0:1787781992.894989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781992.895270:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005950976 00000100:00100000:1.0:1787781992.895281:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005950976 00000100:00100000:1.0:1787781992.895349:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 157 00000100:00100000:1.0:1787781992.895358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:11450:x1874625005950976:12345-192.168.202.56@tcp:36:truncate.0 00010000:00010000:1.0:1787781992.895426:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781992.895457:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db4b expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.895493:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781992.895497:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781992.896168:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.896189:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.896199:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781992.896261:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787781992.896283:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000479385de reply state 00000000be98eb15 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781992.896290:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787781992.896402:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11450:x1874625005950976:12345-192.168.202.56@tcp:36:truncate.0 Request processed in 1043us (1424us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787781992.896409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 157 00000020:00080000:1.0:1787781992.896414:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787781992.902045:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.902072:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.902079:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.902084:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781992.902088:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.902125:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.902145:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:3.0:1787781992.902153:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781992.902158:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781992.902162:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454acd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781992.987349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781992.987567:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005951104 00000100:00100000:1.0:1787781992.987580:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005951104 00000100:00100000:1.0:1787781992.987682:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 158 00000100:00100000:1.0:1787781992.987692:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:11464:x1874625005951104:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:1.0:1787781992.987723:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781992.987750:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ad4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db52 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.987913:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.987932:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.987947:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.987970:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.987976:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.987980:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988424:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988433:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988438:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781992.988475:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787781992.988480:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787781992.988501:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988520:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988528:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988533:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988537:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988541:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781992.988544:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988550:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988562:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781992.988564:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781992.988568:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988573:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454adb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988583:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988586:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988594:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988597:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781992.988598:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988602:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988606:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef448467100) 00010000:00010000:1.0:1787781992.988607:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781992.988609:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988612:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988640:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454ad4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db52 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988650:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db52 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781992.988655:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781992.988656:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781992.988658:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f800, rc 0) 00000100:00100000:1.0:1787781992.988725:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11464:x1874625005951104:12345-192.168.202.56@tcp:101:stat.0 Request processed in 1036us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781992.988740:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 158 00000100:00100000:1.0:1787781993.025341:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.025483:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005951360 00000100:00100000:2.0:1787781993.025497:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005951360 00000100:00100000:2.0:1787781993.025615:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:2.0:1787781993.025624:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11474:x1874625005951360:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781993.025653:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.025680:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454af0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db59 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781993.026077:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000100:00080000:0.0:1787781993.026329:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787781993.026337:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454af0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db59 expref: 21 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.026369:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467200) 00010000:00010000:2.0:1787781993.026373:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781993.026380:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454af0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db59 expref: 21 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.026396:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415000, rc 0) 00000100:00100000:2.0:1787781993.026480:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:11474:x1874625005951360:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 856us (1153us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787781993.026490:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:0.0:1787781993.029436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.029491:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005951616 00000100:00100000:3.0:1787781993.029503:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005951616 00000100:00100000:3.0:1787781993.029560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:3.0:1787781993.029569:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff28450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:11474:x1874625005951616:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1787781993.030196:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff28450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:11474:x1874625005951616:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 625us (771us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787781993.030207:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:0.0:1787781993.079897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.080412:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005951872 00000100:00100000:2.0:1787781993.080425:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005951872 00000100:00100000:2.0:1787781993.080536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:2.0:1787781993.080546:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462058f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:11480:x1874625005951872:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781993.080575:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.080599:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454afe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db60 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.080717:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.080730:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db52 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.080739:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.080781:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db52 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.080849:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db52 expref: 22 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.080866:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb7840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023778048:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781993.080990:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787781993.087941:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb7840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023778048:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781993.087983:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781993.088313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.088417:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005952000 00000100:00100000:2.0:1787781993.088424:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005952000 00010000:00010000:2.0:1787781993.088462:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db52 expref: 23 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.088495:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:2.0:1787781993.088503:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:2351:x1874625005952000:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781993.088520:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781993.088527:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db52 expref: 23 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.088541:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db52 expref: 23 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.088567:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db52 expref: 23 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.088608:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:2.0:1787781993.088614:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.088624:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.088634:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.088668:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781993.088730:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:2351:x1874625005952000:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 227us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.088738:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00010000:00010000:1.0:1787781993.088837:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.088845:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781993.088869:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787781993.089051:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454afe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db60 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.089067:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db60 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.089076:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781993.089078:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787781993.089081:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415600, rc 0) 00000100:00100000:1.0:1787781993.089118:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462058f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:11480:x1874625005951872:12345-192.168.202.56@tcp:101:bash.0 Request processed in 8574us (9332us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787781993.089126:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:1.0:1787781993.095006:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.095139:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005952256 00000100:00100000:2.0:1787781993.095155:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005952256 00000100:00100000:2.0:1787781993.095480:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:2.0:1787781993.095495:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:11480:x1874625005952256:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:2.0:1787781993.095880:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.095902:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.095916:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781993.096763:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787781993.096938:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019be7f01 reply state 00000000079b9c1e transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.097037:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781993.097242:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:11480:x1874625005952256:12345-192.168.202.56@tcp:36:bash.0 Request processed in 1732us (2228us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787781993.097253:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 161 00000020:00080000:2.0:1787781993.097260:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787781993.100369:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.100393:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.100401:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.100408:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781993.100414:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.100424:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.100448:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:2.0:1787781993.100452:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.100459:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.100466:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781993.108538:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.108726:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005952384 00000100:00100000:2.0:1787781993.108756:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005952384 00000100:00100000:2.0:1787781993.108906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:2.0:1787781993.108921:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11480:x1874625005952384:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781993.108954:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.108984:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db67 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.109090:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.109120:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db60 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.109132:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.109177:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db60 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.109194:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db60 expref: 25 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.109210:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb7840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023778176:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781993.109329:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787781993.113081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.113239:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb7840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023778176:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781993.113275:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781993.113939:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005952512 00000100:00100000:1.0:1787781993.113949:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005952512 00010000:00010000:1.0:1787781993.114001:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db60 expref: 26 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781993.114070:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:1.0:1787781993.114082:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446939e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:2351:x1874625005952512:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781993.114118:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781993.114128:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db60 expref: 26 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.114143:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db60 expref: 26 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.114170:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db60 expref: 26 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.114190:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781993.114195:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.114207:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.114217:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.114459:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781993.114536:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446939e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:2351:x1874625005952512:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 455us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781993.114545:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00010000:00010000:2.0:1787781993.115609:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.115643:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781993.115720:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787781993.115726:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781993.115754:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.116133:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db67 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.116160:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db67 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.116170:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:2.0:1787781993.116174:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781993.116248:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:2.0:1787781993.116330:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11480:x1874625005952384:12345-192.168.202.56@tcp:101:bash.0 Request processed in 7412us (7807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.116340:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:0.0:1787781993.119786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.120446:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005952768 00000100:00100000:2.0:1787781993.120461:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005952768 00000100:00100000:2.0:1787781993.120549:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:2.0:1787781993.120560:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11480:x1874625005952768:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:2.0:1787781993.120919:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:11480:x1874625005952768:12345-192.168.202.56@tcp:35:bash.0 Request processed in 359us (1146us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787781993.120928:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:0.0:1787781993.157016:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023778304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781993.157122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781993.157372:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023778304 00000100:00100000:2.0:1787781993.157382:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023778304 00000100:00080000:0.0:1787781993.157521:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787781993.159039:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787781993.159065:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874625023778304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787781993.159111:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787781993.159226:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874625023778304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.159244:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787781993.159355:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023778304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787781993.191698:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781993.191833:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005953024 00000100:00100000:1.0:1787781993.191869:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005953024 00000100:00100000:1.0:1787781993.191968:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:1.0:1787781993.191979:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:11490:x1874625005953024:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781993.192009:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781993.192033:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454b28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db6e expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781993.192681:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787781993.192921:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454b28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db6e expref: 27 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.193246:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467200) 00010000:00010000:1.0:1787781993.193251:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781993.193258:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454b28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db6e expref: 27 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.193275:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e400, rc 0) 00000100:00100000:1.0:1787781993.193404:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:11490:x1874625005953024:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1427us (1724us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787781993.193413:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:3.0:1787781993.197240:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781993.197348:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005953152 00000100:00100000:1.0:1787781993.197360:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005953152 00000100:00100000:1.0:1787781993.197470:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:1.0:1787781993.197482:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:11490:x1874625005953152:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:1.0:1787781993.197589:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.197610:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.197637:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.197655:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.197663:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.197670:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198719:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198736:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198746:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787781993.198838:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198854:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198862:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198869:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198886:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781993.198891:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198900:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198914:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781993.198917:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.198923:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198930:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198944:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198950:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.198956:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199171:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781993.199174:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199181:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199199:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef448467100) 00010000:00010000:1.0:1787781993.199201:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.199204:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199209:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199226:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199231:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199237:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199242:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781993.199245:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199250:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199257:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781993.199259:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.199262:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.199267:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781993.199453:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:11490:x1874625005953152:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 1968us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781993.199464:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:0.0:1787781993.202513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.204217:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005953408 00000100:00100000:3.0:1787781993.204236:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005953408 00000100:00100000:3.0:1787781993.204325:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:3.0:1787781993.204338:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:11490:x1874625005953408:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1787781993.205315:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:11490:x1874625005953408:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 970us (2806us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787781993.205327:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:0.0:1787781993.241721:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.241846:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005953664 00000100:00100000:2.0:1787781993.241860:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005953664 00000100:00100000:2.0:1787781993.242090:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:2.0:1787781993.242115:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:11493:x1874625005953664:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781993.242154:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.242186:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db75 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.242288:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.242307:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.242323:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.242339:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.242346:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.242374:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.242891:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.242903:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.242912:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781993.242924:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787781993.243067:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243076:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243083:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243090:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781993.243095:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243113:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243127:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781993.243130:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.243143:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243150:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454b52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243165:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243171:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243177:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243183:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781993.243186:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243192:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243200:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef45088a600) 00010000:00010000:2.0:1787781993.243203:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.243205:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243210:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454b59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243261:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db75 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243287:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db75 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.243294:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:2.0:1787781993.243296:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781993.243298:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415600, rc 0) 00000100:00100000:2.0:1787781993.243372:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:11493:x1874625005953664:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1260us (1669us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787781993.244456:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:0.0:1787781993.246440:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.246579:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005953792 00000100:00100000:2.0:1787781993.246590:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005953792 00000100:00100000:2.0:1787781993.246713:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:2.0:1787781993.246736:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:11493:x1874625005953792:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1787781993.246847:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.246867:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.246882:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.246914:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.246922:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781993.248249:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.248343:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005953920 00000100:00100000:3.0:1787781993.248365:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005953920 00000100:00100000:3.0:1787781993.248428:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:3.0:1787781993.248438:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:2352:x1874625005953920:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781993.248452:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781993.248552:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.248749:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454b60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db75 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.248770:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:3.0:1787781993.248776:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781993.248905:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:2352:x1874625005953920:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 468us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.248914:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00010000:00010000:2.0:1787781993.249183:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781993.249190:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.249201:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.249211:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:2.0:1787781993.249214:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781993.249219:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.249226:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.249275:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:11493:x1874625005953792:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 2552us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.249284:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:0.0:1787781993.251713:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.251894:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005954176 00000100:00100000:2.0:1787781993.251908:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005954176 00000100:00100000:2.0:1787781993.252148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:2.0:1787781993.252161:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:11493:x1874625005954176:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781993.252469:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:11493:x1874625005954176:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 310us (768us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787781993.252476:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:0.0:1787781993.370544:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781993.372853:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005954432 00000100:00100000:1.0:1787781993.372874:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005954432 00000100:00100000:1.0:1787781993.372968:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:1.0:1787781993.372980:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:11511:x1874625005954432:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1787781993.373015:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781993.373043:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db7c expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.373199:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.373218:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.373232:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781993.373245:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787781993.373596:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db7c expref: 32 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.373621:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db7c expref: 31 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.373632:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781993.373653:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787781993.373659:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183fe00, rc 0) 00000100:00100000:1.0:1787781993.375868:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:11511:x1874625005954432:12345-192.168.202.56@tcp:101:cat.0 Request processed in 2872us (5324us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787781993.375887:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:0.0:1787781993.418686:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781993.418873:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005954560 00000100:00100000:1.0:1787781993.418887:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005954560 00000100:00100000:1.0:1787781993.418978:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:1.0:1787781993.418991:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:11512:x1874625005954560:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787781993.419022:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781993.419050:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db83 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.419160:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.419179:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.419191:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781993.419629:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787781993.419635:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787781993.419722:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.420093:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db83 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.420153:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db83 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.420164:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781993.420168:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787781993.420171:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e600, rc 0) 00000100:00100000:1.0:1787781993.420529:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11512:x1874625005954560:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1539us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781993.420539:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:0.0:1787781993.431970:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.432199:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005954944 00000100:00100000:3.0:1787781993.432216:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005954944 00000100:00100000:3.0:1787781993.432427:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:3.0:1787781993.432438:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11512:x1874625005954944:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1787781993.433421:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:11512:x1874625005954944:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 975us (1475us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787781993.433433:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:0.0:1787781993.437504:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.438107:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005955072 00000100:00100000:3.0:1787781993.438122:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005955072 00000100:00100000:3.0:1787781993.438636:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:3.0:1787781993.438653:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:11512:x1874625005955072:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:3.0:1787781993.438677:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787781993.438715:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454b21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db67 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.438770:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454b7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db7c expref: 32 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.438784:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454a25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db28 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.439066:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:3.0:1787781993.439082:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781993.439186:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:11512:x1874625005955072:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 536us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.439194:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:0.0:1787781993.444150:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.444275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005955200 00000100:00100000:2.0:1787781993.444288:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005955200 00000100:00100000:2.0:1787781993.444370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:2.0:1787781993.444384:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:11512:x1874625005955200:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:2.0:1787781993.444531:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.444551:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.444577:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787781993.445033:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787781993.445278:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:11512:x1874625005955200:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 895us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.445288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:0.0:1787781993.484842:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.484973:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005955328 00000100:00100000:2.0:1787781993.484987:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005955328 00000100:00100000:2.0:1787781993.485056:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:2.0:1787781993.485068:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:11514:x1874625005955328:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781993.485110:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.485139:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db8a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485232:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485252:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485286:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485306:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485313:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485321:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485859:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485871:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485879:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781993.485928:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787781993.485933:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781993.485958:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485972:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.485982:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486000:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486006:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486013:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781993.486018:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486027:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486041:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781993.486045:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.486050:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486056:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454ba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486070:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486075:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486081:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486086:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781993.486104:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486111:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486121:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef45088a900) 00010000:00010000:2.0:1787781993.486123:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.486126:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486133:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486173:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454b9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db8a expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486189:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db8a expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.486196:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088a600) 00010000:00010000:2.0:1787781993.486198:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787781993.486201:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415c00, rc 0) 00000100:00100000:2.0:1787781993.486284:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:11514:x1874625005955328:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1217us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.486292:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 170 00010000:00010000:2.0:1787781993.727350:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787781993.854608:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781993.854624:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781993.856310:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1787781993.856345:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781993.856527:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023778432:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787781993.856811:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787781993.864312:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781993.864422:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005955456 00000100:00100000:1.0:1787781993.864435:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005955456 00000100:00100000:1.0:1787781993.864521:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:1.0:1787781993.864533:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11525:x1874625005955456:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787781993.864589:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787781993.864724:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11525:x1874625005955456:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 193us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781993.864733:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:2.0:1787781993.865663:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023778432:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787781993.870901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.871481:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005955584 00000100:00100000:2.0:1787781993.871494:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005955584 00000100:00100000:2.0:1787781993.871583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 172 00000100:00100000:2.0:1787781993.871595:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:11525:x1874625005955584:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787781993.871694:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871714:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871729:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871748:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871755:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871762:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871836:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871845:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871872:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781993.871928:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787781993.871945:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781993.871962:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871976:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871983:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871990:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.871997:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781993.872001:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872009:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872024:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:2.0:1787781993.872027:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.872033:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872040:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454bbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872067:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872073:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872079:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872083:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781993.872085:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872091:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872230:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9ef45088a900) 00010000:00010000:2.0:1787781993.872233:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.872237:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872242:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454bc2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872259:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872397:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872404:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872418:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781993.872421:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872428:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872437:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088a600) 00010000:00010000:2.0:1787781993.872440:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781993.872443:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.872449:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.873225:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:11525:x1874625005955584:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 958us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.873240:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 172 00000100:00100000:1.0:1787781993.884910:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.884991:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005955840 00000100:00100000:3.0:1787781993.885004:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005955840 00000100:00100000:3.0:1787781993.885135:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:3.0:1787781993.885149:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:11525:x1874625005955840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781993.885178:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781993.885205:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454bd0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db91 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885354:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885371:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885385:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781993.885422:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787781993.885566:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885575:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885582:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885590:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781993.885595:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885604:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885618:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088a600) 00010000:00010000:3.0:1787781993.885621:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781993.885625:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885633:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454bd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885682:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454bd0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db91 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885695:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:3.0:1787781993.885698:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781993.885714:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454bd0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db91 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.885726:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2200, rc 0) 00000100:00100000:3.0:1787781993.885839:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11525:x1874625005955840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 693us (949us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787781993.885848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:0.0:1787781993.915659:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.915753:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005955968 00000100:00100000:2.0:1787781993.915766:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005955968 00000100:00100000:2.0:1787781993.915887:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:2.0:1787781993.915900:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11525:x1874625005955968:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787781993.915961:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787781993.916117:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11525:x1874625005955968:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 220us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.916127:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:0.0:1787781993.921997:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781993.922147:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005956224 00000100:00100000:1.0:1787781993.922161:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005956224 00000100:00100000:1.0:1787781993.922246:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:1.0:1787781993.922259:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11525:x1874625005956224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781993.922288:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781993.922292:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787781993.922329:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db83 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.922370:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781993.922377:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781993.922395:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454be5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db98 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787781993.923383:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787781993.923723:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454bec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.923745:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.923758:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.923891:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454be5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db98 expref: 34 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.923912:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db98 expref: 33 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.923921:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef448467100) 00010000:00010000:1.0:1787781993.923923:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781993.923927:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e800, rc 0) 00000100:00100000:1.0:1787781993.924023:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:11525:x1874625005956224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1766us (2041us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787781993.924033:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:0.0:1787781993.930848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781993.931143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005956480 00000100:00100000:1.0:1787781993.931158:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005956480 00000100:00100000:1.0:1787781993.931232:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:1.0:1787781993.931243:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:11525:x1874625005956480:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787781993.931319:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781993.931355:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454bec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db98 expref: 33 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931379:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef448467100) 00010000:00010000:1.0:1787781993.931394:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781993.931422:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931437:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931449:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931466:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931472:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931478:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931856:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931876:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931884:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931891:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781993.931896:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931905:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931915:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:1.0:1787781993.931918:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.931924:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931931:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454bfa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931951:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931957:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931963:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931968:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781993.931978:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931985:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.931994:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x89c58ea2 (ffff9ef448467b00) 00010000:00010000:1.0:1787781993.931996:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781993.931999:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781993.932005:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454c01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x89c58ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781993.932123:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11525:x1874625005956480:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 880us (1289us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787781993.932132:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:0.0:1787781993.936782:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.937075:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005956608 00000100:00100000:2.0:1787781993.937088:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005956608 00000100:00100000:2.0:1787781993.937246:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:2.0:1787781993.937258:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11525:x1874625005956608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781993.937286:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.937315:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140db9f expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.937361:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.937378:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.937391:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.937508:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db9f expref: 34 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.937528:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db9f expref: 33 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.937538:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781993.937541:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787781993.937546:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414a00, rc 0) 00000100:00100000:2.0:1787781993.937921:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:11525:x1874625005956608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 664us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.937930:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:1.0:1787781993.941827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.943525:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005956864 00000100:00100000:3.0:1787781993.943545:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005956864 00000100:00100000:3.0:1787781993.943644:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 178 00000100:00100000:3.0:1787781993.943656:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f5561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:11525:x1874625005956864:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787781993.943811:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.943833:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.943847:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787781993.951193:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787781993.951215:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361729425427ns, next at 362729421241ns, rc = 0 00000004:00010000:2.0:1787781993.951376:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca4e8640 reply state 0000000011d396c4 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781993.951390:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781993.951540:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f5561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:11525:x1874625005956864:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 7880us (9722us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787781993.951550:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 178 00010000:00010000:0.0:1787781993.954433:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.954456:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.954466:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.954473:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781993.954479:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.954488:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.954509:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:0.0:1787781993.954513:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787781993.954519:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.954526:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781993.956670:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781993.958236:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005956992 00000100:00100000:2.0:1787781993.958257:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005956992 00000100:00100000:2.0:1787781993.958341:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 179 00000100:00100000:2.0:1787781993.958354:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:11525:x1874625005956992:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787781993.958388:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781993.958417:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dba6 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.958498:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dba6 expref: 35 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.958515:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dba6 expref: 35 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781993.958538:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781993.958543:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781993.958548:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415600, rc 0) 00000100:00100000:2.0:1787781993.958710:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:11525:x1874625005956992:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 358us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781993.958719:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 179 00000100:00100000:3.0:1787781993.965362:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.965412:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005957120 00000100:00100000:3.0:1787781993.965424:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005957120 00000100:00100000:3.0:1787781993.965510:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:3.0:1787781993.965523:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+6:2351:x1874625005957120:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787781993.968899:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2351:x1874625005957120:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 3361us (3534us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787781993.968918:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00080000:3.0:1787781993.968980:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787781993.975910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.975959:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005957376 00000100:00100000:3.0:1787781993.975970:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005957376 00000100:00100000:3.0:1787781993.976025:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1787781993.976033:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:11525:x1874625005957376:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787781993.976503:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:11525:x1874625005957376:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 467us (602us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787781993.976511:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1787781993.980622:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.980754:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005957632 00000100:00100000:3.0:1787781993.980765:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005957632 00000100:00100000:3.0:1787781993.980847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 180 00000100:00100000:3.0:1787781993.980856:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef462058780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:11525:x1874625005957632:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787781993.981315:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef462058780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:11525:x1874625005957632:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 458us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.981322:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 180 00000100:00100000:2.0:1787781993.986378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.987246:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005957760 00000100:00100000:3.0:1787781993.987262:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005957760 00000100:00100000:3.0:1787781993.987342:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:3.0:1787781993.987353:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:11525:x1874625005957760:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781993.987378:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781993.987402:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbad expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.987483:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.987508:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.987524:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781993.987575:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781993.987598:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.987629:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbad expref: 38 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.987642:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbad expref: 37 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781993.987649:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:3.0:1787781993.987652:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787781993.987666:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3400, rc 0) 00000100:00100000:3.0:1787781993.987736:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:11525:x1874625005957760:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 386us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.987742:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:3.0:1787781993.992624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781993.992837:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005957888 00000100:00100000:0.0:1787781993.992850:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005957888 00000100:00100000:0.0:1787781993.992915:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:0.0:1787781993.992925:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2351:x1874625005957888:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781993.992950:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781993.992989:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbb4 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787781993.993020:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f636a, blocks: 0x1 00010000:00010000:0.0:1787781993.993044:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1787781993.993049:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781993.993061:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbb4 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.993080:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbb4 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781993.993115:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031e00, rc 0) 00000100:00100000:0.0:1787781993.993187:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005957888:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 264us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781993.993195:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:0.0:1787781993.996051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781993.996131:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005958144 00000100:00100000:3.0:1787781993.996143:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005958144 00000100:00100000:3.0:1787781993.996225:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:3.0:1787781993.996235:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:11525:x1874625005958144:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787781993.996368:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:11525:x1874625005958144:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 135us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781993.996393:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:3.0:1787781994.000409:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781994.000489:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005958272 00000100:00100000:0.0:1787781994.000502:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005958272 00000100:00100000:0.0:1787781994.000577:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:0.0:1787781994.000589:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:11525:x1874625005958272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781994.000613:0:8308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781994.000638:0:8308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbbb expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.000689:0:8308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbb4 expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.000720:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781994.000725:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781994.000731:0:8308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 9 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.000775:0:8308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbb4 expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.000818:0:8308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbb4 expref: 9 pid: 6694 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.000835:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476aa30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023778560:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781994.000959:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47675c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787781994.004574:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476aa30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023778560:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781994.004627:0:8308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 9 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.004664:0:8308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031400, rc 0) 00000100:00100000:3.0:1787781994.004748:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:11525:x1874625005958272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4160us (4353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.004759:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:0.0:1787781994.013308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781994.013960:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005958400 00000100:00100000:1.0:1787781994.013973:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005958400 00010000:00010000:1.0:1787781994.014037:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbb4 expref: 9 pid: 6694 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.014105:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:1.0:1787781994.014116:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2351:x1874625005958400:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781994.014137:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781994.014168:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbb4 expref: 9 pid: 6694 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.014203:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbb4 expref: 9 pid: 6694 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.014233:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90454c32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbb4 expref: 9 pid: 6694 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.014255:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781994.014260:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781994.014282:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 8 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.014296:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 8 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.014343:0:8462:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 8 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.014361:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f556580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8462:1874625023778688:192.168.202.56@tcp:105: 00000100:00100000:1.0:1787781994.014466:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781994.018441:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f556580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8462:1874625023778688:192.168.202.56@tcp:105: 00010000:00010000:1.0:1787781994.018477:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781994.018562:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005958400:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 4437us (5252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.018578:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:1.0:1787781994.020972:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781994.022301:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005958528 00000100:00100000:3.0:1787781994.022319:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005958528 00002000:00100000:3.0:1787781994.022389:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ef47f556580 x1874625005958528/t0(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:140/0 lens 504/0 e 0 to 0 dl 1787782005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787781994.022403:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef47f556580 with x1874625005958528 ext(0->8) 00002000:00010000:3.0:1787781994.022410:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef47f556580 00000100:00100000:3.0:1787781994.023144:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:3.0:1787781994.023159:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f556580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005958528:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787781994.023745:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f556580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:2351:x1874625005958528:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 587us (2785us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787781994.023756:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00002000:00100000:3.0:1787781994.023766:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ef47f556580 x1874625005958528/t4294967314(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:140/0 lens 504/448 e 0 to 0 dl 1787782005 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787781994.023810:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef47f556580 with x1874625005958528 ext(0->8) 00002000:00010000:3.0:1787781994.023816:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef47f556580 00000100:00100000:0.0:1787781994.030352:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781994.030419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005958656 00000100:00100000:1.0:1787781994.030432:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005958656 00000100:00100000:1.0:1787781994.030511:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:1.0:1787781994.030523:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:11525:x1874625005958656:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787781994.133565:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000020:00080000:2.0:1787781994.133589:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787781994.133625:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787781994.133640:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:2.0:1787781994.133667:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:2.0:1787781994.133703:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1787781994.133712:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1787781994.134299:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4791c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023778816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787781994.134392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781994.134485:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023778816 00000100:00100000:0.0:1787781994.134494:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023778816 00000100:00100000:0.0:1787781994.137318:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787781994.137339:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023778816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787781994.137582:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787781994.137586:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787781995 00002000:00010000:0.0:1787781994.137589:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787781994.137598:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787781994 -> 1787781995 00002000:00010000:0.0:1787781994.137601:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787781994.137694:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625023778816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 364us (3302us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787781994.137703:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1787781994.137776:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef4791c2580/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787781994.137783:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4791c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023778816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787781994.138012:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:11525:x1874625005958656:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 107487us (107670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.138023:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00080000:3.0:1787781994.142061:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781994.143709:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781994.144208:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005958784 00000100:00100000:0.0:1787781994.144222:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005958784 00000100:00100000:0.0:1787781994.144299:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1787781994.144310:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f555a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:2352:x1874625005958784:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787781994.202241:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1787781994.202265:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1787781994.202488:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f555a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005958784:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 58171us (58783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.202502:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1787781994.205700:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.206378:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005959040 00000100:00100000:2.0:1787781994.206392:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005959040 00000100:00100000:2.0:1787781994.206466:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:2.0:1787781994.206479:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:11525:x1874625005959040:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787781994.206552:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781994.206589:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3400/0x3ad9816c90454c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbad expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.206611:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781994.206617:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781994.206657:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.206674:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.206684:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781994.207239:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be25c841 reply state 00000000ec46c921 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.207252:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781994.207380:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11525:x1874625005959040:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 901us (1693us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787781994.207406:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:3.0:1787781994.220825:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1787781994.220892:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.220906:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.220915:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.220922:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.220928:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.220938:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.220959:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:3.0:1787781994.220963:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.220969:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.220976:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.221029:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005959168 00000100:00100000:3.0:1787781994.221040:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005959168 00000100:00100000:3.0:1787781994.221110:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:3.0:1787781994.221122:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005959168:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787781994.221453:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787781994.221457:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787781995 -> 1787781994 00002000:00010000:3.0:1787781994.221460:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787781992 00002000:00010000:3.0:1787781994.221462:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787781995 -> 1787781994 00002000:00010000:3.0:1787781994.221465:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787781994.221547:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2352:x1874625005959168:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 425us (737us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787781994.221556:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:3.0:1787781994.227349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781994.227402:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005959424 00000100:00100000:3.0:1787781994.227413:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005959424 00000100:00100000:3.0:1787781994.227485:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:3.0:1787781994.227496:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:11525:x1874625005959424:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787781994.227590:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.227610:0:9081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db9f expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.227620:0:9081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.227680:0:9081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db9f expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.227697:0:9081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db9f expref: 18 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.227715:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023778944:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781994.227858:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4459340c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781994.234558:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023778944:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787781994.234599:0:9081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.235549:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781994.235627:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005959552 00000100:00100000:1.0:1787781994.235636:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005959552 00010000:00010000:1.0:1787781994.235683:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db9f expref: 19 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.235724:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:1.0:1787781994.235733:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:2352:x1874625005959552:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781994.235750:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781994.235757:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db9f expref: 19 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.235770:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db9f expref: 19 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.235841:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db9f expref: 19 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.235859:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:1.0:1787781994.235865:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.235875:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.235883:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.235908:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781994.235972:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:2352:x1874625005959552:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 239us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.235979:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00010000:00010000:1.0:1787781994.236088:0:9081:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.236104:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.236141:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.236148:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.236156:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.236169:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781994.236175:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.236184:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.236194:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:1.0:1787781994.236197:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787781994.236202:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.236209:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2200/0x3ad9816c90454c47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.236261:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479148780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:11525:x1874625005959424:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 8767us (8927us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787781994.236270:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:3.0:1787781994.240162:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781994.240307:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005959680 00000100:00100000:1.0:1787781994.240321:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005959680 00000100:00100000:1.0:1787781994.240393:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:1.0:1787781994.240405:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2350:x1874625005959680:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787781994.240467:0:8308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.240493:0:8308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 8 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.240525:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787781994.240530:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781994.240536:0:8308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.240583:0:8308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 8 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.240600:0:8308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 8 pid: 8308 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.240618:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f554b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023779072:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781994.240717:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44672cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787781994.244103:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f554b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023779072:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781994.244144:0:8308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.244980:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.245518:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005959808 00000100:00100000:2.0:1787781994.245529:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005959808 00010000:00010000:2.0:1787781994.245585:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 9 pid: 8308 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.245635:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:2.0:1787781994.245647:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f5552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2351:x1874625005959808:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781994.245667:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781994.245698:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 9 pid: 8308 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.245714:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 9 pid: 8308 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.245747:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c90454c39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbbb expref: 9 pid: 8308 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.245767:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781994.245772:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787781994.245778:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.245856:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.245907:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781994.245977:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f5552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005959808:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 331us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.245987:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00010000:00010000:3.0:1787781994.246193:0:8308:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.246202:0:8308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.246234:0:8308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.246243:0:8308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.246264:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.246272:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781994.246276:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.246286:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.246299:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.246307:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9a06352/0x3ad9816c90454c4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.246368:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2350:x1874625005959680:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 5964us (6220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.246376:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:3.0:1787781994.249914:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.250081:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005960064 00000100:00100000:2.0:1787781994.250101:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005960064 00000100:00100000:2.0:1787781994.250179:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:2.0:1787781994.250190:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+17:11525:x1874625005960064:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787781994.250301:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.250323:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.250337:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.250605:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.250618:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dba6 expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.250627:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.250670:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dba6 expref: 18 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.250709:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dba6 expref: 18 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.250727:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023779200:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781994.250864:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787781994.255525:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023779200:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781994.255569:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.257302:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781994.257381:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005960192 00000100:00100000:3.0:1787781994.257393:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005960192 00010000:00010000:3.0:1787781994.257445:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dba6 expref: 19 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.257522:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:3.0:1787781994.257534:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f557c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:2351:x1874625005960192:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781994.257554:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781994.257562:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dba6 expref: 19 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.257577:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dba6 expref: 19 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.257605:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454c1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dba6 expref: 19 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.257624:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:3.0:1787781994.257631:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.257643:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.257651:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.257691:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781994.257757:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f557c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+18:2351:x1874625005960192:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 225us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.257766:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 72 00010000:00010000:1.0:1787781994.258015:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.258024:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781994.258291:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787781994.258468:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787781994.258522:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787781994.258628:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f557840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874625023779328:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787781994.258692:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781994.258836:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18780 going to sleep for 11 seconds 00000100:00100000:0.0:1787781994.260488:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023779328 00000100:00100000:0.0:1787781994.260507:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023779328 00000100:00100000:0.0:1787781994.260611:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787781994.260624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f556d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874625023779328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787781994.260761:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f556d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874625023779328:12345-0@lo:1000:mdt00_000.0 Request processed in 140us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781994.260770:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787781994.260913:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787781994.260921:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef4791c2580, transno 4294967315 00000100:00100000:1.0:1787781994.260947:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f557840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874625023779328:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787781994.261569:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787781994.261670:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f557840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874625023779456:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787781994.261744:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781994.262508:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787781994.262557:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023779456 00000100:00100000:2.0:1787781994.262565:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023779456 00000100:00100000:2.0:1787781994.262614:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787781994.262626:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f554b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1874625023779456:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787781994.263289:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f554b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874625023779456:12345-0@lo:1000:mdt00_000.0 Request processed in 664us (1543us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787781994.263299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787781994.263400:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f557840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874625023779456:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787781994.263459:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263471:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263479:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263486:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781994.263492:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263501:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263522:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781994.263539:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781994.263547:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263555:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454c5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263595:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263602:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263608:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263614:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781994.263617:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263623:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263631:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088a600) 00010000:00010000:2.0:1787781994.263634:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781994.263637:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263643:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454b98 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263670:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263697:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db8a expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263707:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263746:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db8a expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.263762:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db8a expref: 21 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.263776:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023779584:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781994.264566:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787781994.267784:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023779584:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781994.268150:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.269254:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.269332:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005960320 00000100:00100000:2.0:1787781994.269343:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005960320 00010000:00010000:2.0:1787781994.269393:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db8a expref: 22 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.269437:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:2.0:1787781994.269448:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:2351:x1874625005960320:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781994.269468:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781994.269476:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db8a expref: 22 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.269490:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db8a expref: 22 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.269543:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454bb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140db8a expref: 22 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.269564:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088a600) 00010000:00010000:2.0:1787781994.269569:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.269579:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.269587:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.269618:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781994.269683:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:2351:x1874625005960320:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 236us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.269691:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 73 00010000:00010000:3.0:1787781994.269837:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.269847:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.269861:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.269868:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.269875:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.269881:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.269886:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.269894:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.269904:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088a600) 00010000:00010000:3.0:1787781994.269907:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.269910:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.269928:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454c63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.270151:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.270158:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.270165:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.270169:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.270172:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.270177:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.270188:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088a600) 00010000:00010000:3.0:1787781994.270190:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787781994.270192:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.270197:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454c55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.270453:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:11525:x1874625005960064:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 20263us (20552us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787781994.270463:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 186 00000020:00080000:3.0:1787781994.270475:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787781994.270673:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781994.270679:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781994.271524:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787781994.271537:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787781994.277248:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781994.277412:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005960576 00000100:00100000:3.0:1787781994.277426:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005960576 00000100:00100000:3.0:1787781994.277686:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:3.0:1787781994.277699:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:11525:x1874625005960576:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787781994.278889:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787781994.279357:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787781994.279432:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.279454:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.279468:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.279478:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.279485:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.279491:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.279522:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787781994.279654:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:11525:x1874625005960576:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1953us (2416us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787781994.279664:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00000020:00080000:3.0:1787781994.279671:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787781994.280528:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781994.280539:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.280549:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787781994.280554:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.280565:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.280582:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ef44a7db400) 00010000:00010000:1.0:1787781994.280585:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787781994.280590:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.280597:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3600/0x3ad9816c90454c6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.280637:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781994.280639:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781994.280640:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787781994.497904:0:12520:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787781994.497919:0:12520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787781994.497961:0:12520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787781994.497969:0:12520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787781994.657688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.657853:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005960832 00000100:00100000:2.0:1787781994.657867:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005960832 00000100:00100000:2.0:1787781994.657944:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:2.0:1787781994.657956:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:11535:x1874625005960832:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781994.657991:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.658020:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454c71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbc2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.658393:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454c78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.658413:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454c78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.658429:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454c78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781994.658443:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787781994.658674:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454c71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc2 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.658693:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454c78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc2 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.658702:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781994.658705:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787781994.658709:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415000, rc 0) 00000100:00100000:2.0:1787781994.658831:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11535:x1874625005960832:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 876us (1153us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787781994.658840:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:3.0:1787781994.662472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.662819:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005960960 00000100:00100000:2.0:1787781994.662836:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005960960 00000100:00100000:3.0:1787781994.662941:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:3.0:1787781994.663064:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11535:x1874625005960960:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:3.0:1787781994.663178:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663201:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663276:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663295:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663301:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663306:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663638:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663645:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663650:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781994.663695:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663717:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663722:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663728:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663733:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.663736:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663742:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663754:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:3.0:1787781994.663756:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.663760:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663764:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663777:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663780:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663785:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663812:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.663815:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663820:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663830:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef44a7dbf00) 00010000:00010000:3.0:1787781994.663833:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.663836:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663842:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663859:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663866:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663871:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663876:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.663879:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663885:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663904:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a7db600) 00010000:00010000:3.0:1787781994.663906:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.663910:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.663914:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.664518:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11535:x1874625005960960:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 1562us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.664530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:0.0:1787781994.701665:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.701813:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005961216 00000100:00100000:2.0:1787781994.701825:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005961216 00000100:00100000:2.0:1787781994.701896:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:2.0:1787781994.701908:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11538:x1874625005961216:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781994.701945:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.701973:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454c9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbc9 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702064:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702081:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702107:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702126:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702134:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702141:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702562:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702572:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702579:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781994.702590:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787781994.702719:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702728:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702735:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702742:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781994.702747:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702756:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702771:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781994.702775:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.702781:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702822:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454ca2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702837:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702843:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702848:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702853:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781994.702863:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702869:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702876:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef45088a900) 00010000:00010000:2.0:1787781994.702879:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.702882:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702888:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702940:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454c9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc9 expref: 27 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702955:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc9 expref: 26 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.702963:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:2.0:1787781994.702965:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781994.702968:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414a00, rc 0) 00000100:00100000:2.0:1787781994.703054:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:11538:x1874625005961216:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1147us (1404us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787781994.703064:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:0.0:1787781994.707657:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.707775:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005961344 00000100:00100000:2.0:1787781994.707813:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005961344 00000100:00100000:2.0:1787781994.707891:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:2.0:1787781994.707902:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:11538:x1874625005961344:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1787781994.708009:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.708029:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.708043:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.708079:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.708097:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.708105:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.708112:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781994.708118:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.708126:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.708142:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:2.0:1787781994.708146:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781994.708152:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.708159:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454cbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.708258:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:11538:x1874625005961344:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 357us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.708267:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:2.0:1787781994.715302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781994.722734:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005961600 00000100:00100000:3.0:1787781994.722759:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005961600 00000100:00100000:3.0:1787781994.723173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:3.0:1787781994.723187:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+26:11538:x1874625005961600:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1787781994.723987:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:11538:x1874625005961600:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 798us (8696us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787781994.723998:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00010000:00010000:1.0:1787781994.750007:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781994.752062:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781994.754636:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005961856 00000100:00100000:1.0:1787781994.754655:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005961856 00000100:00100000:1.0:1787781994.754830:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:1.0:1787781994.754843:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:11073:x1874625005961856:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1787781994.754875:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781994.754904:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454cc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbd0 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.755046:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.755067:0:9081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc9 expref: 28 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.755079:0:9081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.755139:0:9081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc9 expref: 28 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.755172:0:9081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc9 expref: 28 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.755189:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f5543c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023779712:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781994.755321:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fa3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781994.760339:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781994.760383:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005961984 00000100:00100000:1.0:1787781994.760395:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005961984 00010000:00010000:1.0:1787781994.760452:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc9 expref: 29 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.760506:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:1.0:1787781994.760518:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f555e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:2351:x1874625005961984:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781994.760538:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781994.760546:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc9 expref: 29 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.760562:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc9 expref: 29 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.760591:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:1.0:1787781994.760599:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.760610:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.760642:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781994.760665:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787781994.760728:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f555e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:2351:x1874625005961984:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 213us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781994.760736:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 74 00010000:00010000:3.0:1787781994.761675:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454cb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc9 expref: 28 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.761697:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f5543c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023779712:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781994.761725:0:9081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.761735:0:9081:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.761754:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781994.761806:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787781994.762012:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454cc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd0 expref: 29 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.762028:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd0 expref: 28 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.762038:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:3.0:1787781994.762041:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787781994.762044:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e600, rc 0) 00000100:00100000:3.0:1787781994.762110:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:11073:x1874625005961856:12345-192.168.202.56@tcp:101:bash.0 Request processed in 7270us (10061us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787781994.762120:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:1.0:1787781994.771106:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.771196:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005962240 00000100:00100000:2.0:1787781994.771209:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005962240 00000100:00100000:2.0:1787781994.771289:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 192 00000100:00100000:2.0:1787781994.771302:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f5543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:11073:x1874625005962240:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:2.0:1787781994.771685:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.771708:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.771722:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781994.771831:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787781994.771861:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4f841dc reply state 00000000aafe2c70 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.771873:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787781994.771928:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787781994.772054:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f5543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11073:x1874625005962240:12345-192.168.202.56@tcp:36:bash.0 Request processed in 752us (973us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787781994.772062:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 192 00000020:00080000:2.0:1787781994.772069:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787781994.776406:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.776468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005962368 00000100:00100000:2.0:1787781994.776481:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005962368 00000100:00100000:2.0:1787781994.776554:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:2.0:1787781994.776566:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11073:x1874625005962368:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781994.776601:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.776630:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ce1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbd7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.776714:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd7 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.776732:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd7 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.776756:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:2.0:1787781994.776760:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787781994.776765:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414400, rc 0) 00000100:00100000:2.0:1787781994.776989:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+33:11073:x1874625005962368:12345-192.168.202.56@tcp:101:bash.0 Request processed in 424us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.776999:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 193 00010000:00010000:3.0:1787781994.777174:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.777184:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.777191:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.777198:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.777204:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.777238:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.777254:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:3.0:1787781994.777257:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.777262:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.777270:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454cda lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.784077:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781994.784288:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005962496 00000100:00100000:3.0:1787781994.784302:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005962496 00000100:00100000:3.0:1787781994.784381:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:3.0:1787781994.784393:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f499e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:11073:x1874625005962496:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1787781994.784419:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781994.784445:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbde expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787781994.784490:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f636a, atime: 0x6a8f6368, ctime: 0x6a8f636a, blocks: 0xb 00010000:00010000:3.0:1787781994.784527:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1787781994.784533:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781994.784544:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbde expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.784564:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbde expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.784598:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2c00, rc 0) 00000100:00100000:3.0:1787781994.785438:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f499e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:11073:x1874625005962496:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1041us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.785461:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:1.0:1787781994.792559:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.792754:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005962624 00000100:00100000:2.0:1787781994.792769:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005962624 00002000:00010000:2.0:1787781994.793149:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787781994.793156:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef47f49b480 with x1874625005962624 ext(0->18446744073709551615) 00002000:00010000:2.0:1787781994.793172:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef47f49b480. 00000100:00100000:2.0:1787781994.793218:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1787781994.793230:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2352:x1874625005962624:12345-192.168.202.56@tcp:10:bash.0 00002000:00010000:2.0:1787781994.795643:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787781994.795653:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787781994 -> 1787781995 00002000:00010000:2.0:1787781994.795657:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787781992 -> 1787781992 00002000:00010000:2.0:1787781994.795658:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787781994 -> 1787781995 00002000:00010000:2.0:1787781994.795660:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787781994.795753:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2352:x1874625005962624:12345-192.168.202.56@tcp:10:bash.0 Request processed in 2519us (3203us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787781994.795765:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00002000:00010000:2.0:1787781994.795771:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787781994.795775:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef47f49b480 with x1874625005962624 ext(0->18446744073709551615) 00002000:00010000:2.0:1787781994.795783:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef47f49b480. 00000100:00100000:2.0:1787781994.844101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781994.845866:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005962752 00000100:00100000:3.0:1787781994.845888:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005962752 00000100:00100000:3.0:1787781994.846261:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:3.0:1787781994.846276:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11552:x1874625005962752:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:3.0:1787781994.846378:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.846400:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.846414:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.846436:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.846443:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.846450:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.846887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.846910:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.846917:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781994.846980:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.846993:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847000:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847007:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847014:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.847018:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847026:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847039:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:3.0:1787781994.847042:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.847047:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847053:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454cef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847074:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847094:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847102:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847107:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.847110:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847118:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847127:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef44a7db100) 00010000:00010000:3.0:1787781994.847129:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.847133:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847139:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454cf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847156:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847162:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847168:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847180:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.847184:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847190:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847199:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:3.0:1787781994.847202:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.847205:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.847211:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454cfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.847325:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11552:x1874625005962752:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 1050us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.847334:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:1.0:1787781994.872719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.875384:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005963008 00000100:00100000:2.0:1787781994.875405:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005963008 00000100:00100000:2.0:1787781994.875514:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:2.0:1787781994.875526:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f499a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11555:x1874625005963008:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781994.875553:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.875583:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbe5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.875697:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.875715:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.875729:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.875765:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.875784:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.875812:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.876560:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454d19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.876576:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.876584:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781994.876596:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787781994.876719:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.876727:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.876734:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.876741:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781994.876746:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.876766:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877055:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781994.877060:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.877067:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877073:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877099:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877105:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877112:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877117:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781994.877120:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877126:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877133:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef45088a900) 00010000:00010000:2.0:1787781994.877135:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.877138:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877155:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877218:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbe5 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877235:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbe5 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.877243:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:2.0:1787781994.877245:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787781994.877247:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451415400, rc 0) 00000100:00100000:2.0:1787781994.877478:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f499a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:11555:x1874625005963008:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1952us (4774us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787781994.877488:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:1.0:1787781994.884219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781994.884410:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005963136 00000100:00100000:0.0:1787781994.884423:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005963136 00000100:00100000:0.0:1787781994.884515:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:0.0:1787781994.884528:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:11555:x1874625005963136:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1787781994.884618:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.884640:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd0 expref: 34 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.884651:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.884703:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd0 expref: 34 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.884719:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd0 expref: 34 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.884737:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a54780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023779840:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781994.884895:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef48182ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787781994.887557:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a54780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023779840:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781994.887597:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781994.892119:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.893735:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005963392 00000100:00100000:2.0:1787781994.893762:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005963392 00000100:00100000:2.0:1787781994.893928:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1787781994.893941:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:5586:x1874625005963392:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787781994.894417:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:5586:x1874625005963392:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 477us (2312us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787781994.894431:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:3.0:1787781994.900255:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.900649:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005963520 00000100:00100000:2.0:1787781994.900663:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005963520 00010000:00010000:2.0:1787781994.900720:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd0 expref: 36 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781994.900924:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:2.0:1787781994.900937:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:2350:x1874625005963520:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781994.900958:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781994.900966:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd0 expref: 36 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.900981:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd0 expref: 36 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.901017:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ccc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd0 expref: 36 pid: 9081 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.901038:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:2.0:1787781994.901044:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.901055:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.901064:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.901109:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781994.901170:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:2350:x1874625005963520:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 235us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781994.901178:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00010000:00010000:3.0:1787781994.902016:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.902029:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.902069:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.902075:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.902110:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.902117:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.902122:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.902132:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.902144:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:3.0:1787781994.902147:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781994.902152:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.902159:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781994.902233:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:11555:x1874625005963136:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 17705us (18027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781994.902242:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:3.0:1787781994.906294:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.906377:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005963776 00000100:00100000:2.0:1787781994.906414:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005963776 00000100:00100000:2.0:1787781994.906506:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:2.0:1787781994.906519:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+34:11555:x1874625005963776:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781994.907159:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:11555:x1874625005963776:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 639us (876us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787781994.907171:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:1.0:1787781994.947858:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781994.948000:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005964032 00000100:00100000:3.0:1787781994.948013:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005964032 00000100:00100000:2.0:1787781994.948212:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 197 00000100:00100000:2.0:1787781994.948228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+35:11566:x1874625005964032:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1787781994.948266:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781994.948297:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454d2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbec expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.948397:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.948416:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.948430:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.948448:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.949594:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.949603:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950001:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454d43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950012:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950020:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781994.950032:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787781994.950428:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950437:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950445:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950708:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781994.950714:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950723:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950740:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781994.950743:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.950748:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950770:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415600/0x3ad9816c90454d35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.950785:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.951786:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.951821:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.951828:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781994.951833:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.951842:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.951855:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef45088a900) 00010000:00010000:2.0:1787781994.951859:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781994.951863:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.951870:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414a00/0x3ad9816c90454d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.951967:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415c00/0x3ad9816c90454d2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbec expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.951985:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454d43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbec expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.952008:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:2.0:1787781994.952011:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781994.952014:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9e00, rc 0) 00000100:00100000:2.0:1787781994.952133:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:11566:x1874625005964032:12345-192.168.202.56@tcp:101:cat.0 Request processed in 3908us (4289us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787781994.952143:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 197 00000100:00100000:1.0:1787781994.959337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.959545:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005964288 00000100:00100000:2.0:1787781994.959560:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005964288 00000100:00100000:2.0:1787781994.959688:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:2.0:1787781994.959701:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:11566:x1874625005964288:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:2.0:1787781994.960065:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:11566:x1874625005964288:12345-192.168.202.56@tcp:35:cat.0 Request processed in 366us (746us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787781994.960075:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:0.0:1787781994.977533:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781994.977762:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005964544 00000100:00100000:2.0:1787781994.977776:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005964544 00000100:00100000:0.0:1787781994.978249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00100000:0.0:1787781994.978264:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:11567:x1874625005964544:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:0.0:1787781994.978354:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787781994.978393:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454d43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbec expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.978420:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415400/0x3ad9816c90454d19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbe5 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.978433:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414400/0x3ad9816c90454ce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbd7 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.978444:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:0.0:1787781994.978579:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787781994.978610:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.978627:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.978638:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.978657:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.978664:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.978671:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.979149:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.979159:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.979167:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781994.981390:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787781994.981406:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362759616157ns, next at 363759613225ns, rc = 0 00010000:00010000:0.0:1787781994.981756:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.981778:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.981924:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.981936:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.981942:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.981949:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982693:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787781994.982734:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982756:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982763:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982769:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781994.982774:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982781:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982830:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a9a7400) 00010000:00010000:0.0:1787781994.982835:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787781994.982840:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982847:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454d5f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982874:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982880:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982886:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982891:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781994.982900:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982907:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982917:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:0.0:1787781994.982919:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781994.982923:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781994.982928:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454d51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787781994.982940:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c7a9f7f reply state 00000000c60f0abd transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781994.982949:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781994.983096:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+37:11567:x1874625005964544:12345-192.168.202.56@tcp:36:rm.0 Request processed in 4819us (5563us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787781994.983107:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 198 00010000:00010000:3.0:1787781994.986937:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.986970:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.987003:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.987009:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781994.987025:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.987034:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.987056:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef44a9a7e00) 00010000:00010000:3.0:1787781994.987060:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781994.987066:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781994.987072:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454d58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.992604:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787781994.992630:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.992647:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787781994.992653:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.992667:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.992695:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ef44a9a7400) 00010000:00010000:2.0:1787781994.992726:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787781994.992734:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.992741:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454d66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781994.992779:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781994.992781:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787781994.992783:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787781995.028842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.029200:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005964800 00000100:00100000:3.0:1787781995.029213:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005964800 00000100:00100000:3.0:1787781995.029311:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:3.0:1787781995.029324:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+36:11573:x1874625005964800:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1787781995.029361:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781995.029389:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454d6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbf3 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.029582:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.029626:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.029640:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.029659:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.029667:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.029674:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787781995.030261:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787781995.031607:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787781995.031902:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.031923:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.031937:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.032537:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.032547:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.032555:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.032561:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781995.032567:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.032593:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.032610:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781995.032613:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781995.032620:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.032627:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2a00/0x3ad9816c90454d74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781995.032646:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000070a2029 reply state 000000006b738cc8 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781995.032657:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787781995.032702:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2800/0x3ad9816c90454d6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbf3 expref: 39 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.032719:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbf3 expref: 38 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.032727:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781995.032730:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781995.032732:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9000, rc 0) 00000100:00100000:2.0:1787781995.033406:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+39:11573:x1874625005964800:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4081us (4619us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787781995.033419:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 199 00010000:00010000:3.0:1787781995.036700:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.036720:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.036728:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.036734:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781995.036740:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.036749:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.036770:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef44a7db100) 00010000:00010000:3.0:1787781995.036830:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781995.036836:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.036844:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454d7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781995.037785:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.038274:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005964928 00000100:00100000:3.0:1787781995.038289:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005964928 00000100:00100000:3.0:1787781995.038476:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:3.0:1787781995.038490:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2352:x1874625005964928:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1787781995.038517:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781995.038545:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dbfa expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787781995.038581:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787781995.038607:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1787781995.038613:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781995.038626:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbfa expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.038648:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbfa expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.038663:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3e00, rc 0) 00000100:00100000:3.0:1787781995.038746:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2352:x1874625005964928:12345-192.168.202.56@tcp:101:bash.0 Request processed in 258us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.038754:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00080000:0.0:1787781995.039056:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787781995.041885:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.042354:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005965056 00000100:00100000:3.0:1787781995.042377:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005965056 00000100:00100000:3.0:1787781995.042502:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1787781995.042514:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:11573:x1874625005965056:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1787781995.042539:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781995.042563:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc01 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.042604:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbfa expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.042614:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781995.042619:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781995.042625:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.042672:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbfa expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.042689:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbfa expref: 9 pid: 6697 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.042707:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874625023779968:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781995.042855:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47675cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787781995.047187:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781995.047331:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005965184 00000100:00100000:1.0:1787781995.047343:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005965184 00010000:00010000:1.0:1787781995.047396:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbfa expref: 10 pid: 6697 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781995.047448:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:1.0:1787781995.047469:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:2351:x1874625005965184:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787781995.047489:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787781995.047520:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbfa expref: 10 pid: 6697 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.047561:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbfa expref: 10 pid: 6697 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.047598:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781995.047603:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787781995.047612:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.047624:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.047671:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781995.047687:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478dbed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1874625023780096:192.168.202.56@tcp:105: 00000100:00100000:1.0:1787781995.047837:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fa3780 going to sleep for 11 seconds 00010000:00010000:3.0:1787781995.048285:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454d90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbfa expref: 10 pid: 6697 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.048323:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1874625023779968:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781995.048357:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.048370:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2000, rc 0) 00000100:00100000:3.0:1787781995.048414:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:11573:x1874625005965056:12345-192.168.202.56@tcp:101:bash.0 Request processed in 5903us (6545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.048423:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:2.0:1787781995.051353:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478dbed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5818:1874625023780096:192.168.202.56@tcp:105: 00010000:00010000:2.0:1787781995.051406:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781995.051493:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005965184:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 4024us (4319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781995.051506:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:2.0:1787781995.055317:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.055466:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005965440 00000100:00100000:3.0:1787781995.055479:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005965440 00000100:00100000:3.0:1787781995.055548:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:3.0:1787781995.055561:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+38:11573:x1874625005965440:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:3.0:1787781995.056318:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+39:11573:x1874625005965440:12345-192.168.202.56@tcp:35:bash.0 Request processed in 756us (1012us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787781995.056330:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:1.0:1787781995.203620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.203687:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005965568 00000100:00100000:3.0:1787781995.203700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005965568 00000100:00100000:3.0:1787781995.203815:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:3.0:1787781995.203830:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+39:11589:x1874625005965568:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781995.203939:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781995.203970:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454d9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc08 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.204077:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.204127:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.204142:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781995.204221:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787781995.204225:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781995.204254:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.204284:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454d9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc08 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.204306:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc08 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.204315:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:3.0:1787781995.204318:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787781995.204322:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3c00, rc 0) 00000100:00100000:3.0:1787781995.204401:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+40:11589:x1874625005965568:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 574us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.204409:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:1.0:1787781995.211101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781995.211373:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005965824 00000100:00100000:2.0:1787781995.211386:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005965824 00000100:00100000:2.0:1787781995.211514:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:2.0:1787781995.211527:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+40:11589:x1874625005965824:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781995.211556:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781995.211585:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454dac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc0f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.211740:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9c00/0x3ad9816c90454db3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.211757:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9c00/0x3ad9816c90454db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.211770:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9c00/0x3ad9816c90454db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781995.211783:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787781995.212005:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc0f expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.212027:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9c00/0x3ad9816c90454db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc0f expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.212072:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781995.212076:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781995.212090:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9c00, rc 0) 00000100:00100000:2.0:1787781995.212330:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+42:11589:x1874625005965824:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 805us (1256us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787781995.212339:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:1.0:1787781995.216728:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781995.216840:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781995.216973:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005966080 00000100:00100000:2.0:1787781995.216985:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005966080 00000100:00100000:2.0:1787781995.217064:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 202 00000100:00100000:2.0:1787781995.217076:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+42:11589:x1874625005966080:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781995.217122:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781995.217389:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454dc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc16 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.217525:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8e00/0x3ad9816c90454dc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.217543:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8e00/0x3ad9816c90454dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.217556:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8e00/0x3ad9816c90454dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781995.217571:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787781995.217731:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454dc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc16 expref: 45 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.217778:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8e00/0x3ad9816c90454dc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc16 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.217816:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787781995.217820:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787781995.217825:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8e00, rc 0) 00000100:00100000:2.0:1787781995.217913:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+44:11589:x1874625005966080:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 838us (1202us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787781995.217920:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 202 00000100:00100000:3.0:1787781995.219545:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005966208 00000100:00100000:3.0:1787781995.219562:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005966208 00000100:00100000:3.0:1787781995.219643:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:3.0:1787781995.219654:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+44:2349:x1874625005966208:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781995.219671:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781995.219713:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9c00/0x3ad9816c90454db3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc0f expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.219734:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:3.0:1787781995.219740:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781995.219854:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+43:2349:x1874625005966208:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 201us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.219862:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1787781995.229342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.229604:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005966336 00000100:00100000:3.0:1787781995.229617:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005966336 00000100:00100000:3.0:1787781995.229736:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:3.0:1787781995.229749:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4767783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005966336:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:3.0:1787781995.229841:0:8308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.229867:0:8308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.229876:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787781995.229881:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781995.229887:0:8308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.229943:0:8308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.229959:0:8308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 8 pid: 6695 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.229997:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8308:1874625023780224:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781995.230337:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47675cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787781995.233818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781995.234725:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005966464 00000100:00100000:2.0:1787781995.234750:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005966464 00002000:00100000:2.0:1787781995.234879:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ef47677bc00 x1874625005966464/t0(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:141/0 lens 504/0 e 0 to 0 dl 1787782006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781995.234898:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef47677bc00 with x1874625005966464 ext(0->8) 00010000:00010000:2.0:1787781995.234910:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 9 pid: 6695 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.234947:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 9 pid: 6695 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781995.234963:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ef47677bc00 00000100:00100000:2.0:1787781995.235004:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:2.0:1787781995.235023:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2351:x1874625005966464:12345-192.168.202.56@tcp:4:lfs.0 00000100:00100000:3.0:1787781995.236289:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8308:1874625023780224:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781995.236324:0:8308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781995.237299:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:2351:x1874625005966464:12345-192.168.202.56@tcp:4:lfs.0 Request processed in 2272us (3520us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787781995.237334:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00002000:00100000:2.0:1787781995.237358:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ef47677bc00 x1874625005966464/t4294967308(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:141/0 lens 504/448 e 0 to 0 dl 1787782006 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781995.237369:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef47677bc00 with x1874625005966464 ext(0->8) 00010000:00010000:2.0:1787781995.237377:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 11 pid: 6695 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.237395:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 11 pid: 6695 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781995.237403:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ef47677bc00 00000100:00100000:1.0:1787781995.241142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781995.241289:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005966592 00000100:00100000:0.0:1787781995.241303:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005966592 00010000:00010000:0.0:1787781995.241361:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 11 pid: 6695 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781995.241408:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:0.0:1787781995.241439:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:2349:x1874625005966592:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781995.241460:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787781995.241488:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787781995.241491:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787781996 00002000:00010000:0.0:1787781995.241494:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787781996 00002000:00010000:0.0:1787781995.241508:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787781996 00010000:00010000:0.0:1787781995.241516:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 11 pid: 6695 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.241538:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 11 pid: 6695 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.241577:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c90454d97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc01 expref: 11 pid: 6695 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.241603:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781995.241609:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781995.241615:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.241632:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.241680:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781995.241840:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:2349:x1874625005966592:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 353us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781995.241848:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00010000:00010000:3.0:1787781995.243022:0:8308:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.243052:0:8308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.243104:0:8308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.243114:0:8308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.243123:0:8308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.243238:0:8308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781995.243243:0:8308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.243274:0:8308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.243296:0:8308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.243305:0:8308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000961bf01c/0x3ad9816c90454dd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.243429:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4767783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2351:x1874625005966336:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 13676us (14104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.243440:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:1.0:1787781995.247051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.247256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005966848 00000100:00100000:3.0:1787781995.247270:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005966848 00000100:00100000:3.0:1787781995.247341:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:3.0:1787781995.247353:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+43:11589:x1874625005966848:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:3.0:1787781995.247445:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8e00/0x3ad9816c90454dc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc16 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787781995.247829:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787781995.247885:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787781995.252782:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787781995.253480:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.253510:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbf3 expref: 47 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.253521:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.253579:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbf3 expref: 47 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.253600:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbf3 expref: 47 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781995.253617:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478e4e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874625023780352:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781995.253752:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fa3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787781995.260621:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.260702:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005966976 00000100:00100000:3.0:1787781995.260714:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005966976 00010000:00010000:3.0:1787781995.260772:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbf3 expref: 48 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.260871:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:3.0:1787781995.260884:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+48:2352:x1874625005966976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781995.260903:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781995.260911:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbf3 expref: 48 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.260937:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbf3 expref: 48 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.260971:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:3.0:1787781995.260978:0:8462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.260988:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.260998:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.261023:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781995.261115:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+48:2352:x1874625005966976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 233us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.261124:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00010000:00010000:2.0:1787781995.261943:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9000/0x3ad9816c90454d82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbf3 expref: 47 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781995.261977:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478e4e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874625023780352:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781995.262006:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.262016:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.262022:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787781995.262391:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787781995.262685:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787781995.262862:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023780480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787781995.262951:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787781995.263266:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a240 going to sleep for 11 seconds 00000100:00100000:1.0:1787781995.263745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023780480 00000100:00100000:1.0:1787781995.263755:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023780480 00000100:00100000:1.0:1787781995.263866:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787781995.263877:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1874625023780480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787781995.264386:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1874625023780480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 510us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781995.264395:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787781995.264502:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023780480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787781995.265338:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787781995.265451:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44693b0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023780608:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787781995.265500:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787781995.265517:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781995.265555:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef473d59600 going to sleep for 11 seconds 00000100:00100000:2.0:1787781995.265637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023780608 00000100:00100000:2.0:1787781995.265645:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023780608 00000100:00100000:2.0:1787781995.265684:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787781995.265692:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1874625023780608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787781995.265908:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5837:x1874625023780608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 215us (389us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787781995.265916:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787781995.266239:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44693b0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874625023780608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787781995.266306:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787781995.266355:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.266366:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.266374:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.266381:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781995.266386:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.266395:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.266414:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:3.0:1787781995.266418:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787781995.266424:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.266430:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454ddd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787781995.266641:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787781995.266767:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1787781995.266780:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363044990406ns, next at 364044988046ns, rc = 0 00000001:00080000:3.0:1787781995.267422:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787781995.267558:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:0.0:1787781995.267563:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787781995.267574:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8e00/0x3ad9816c90454dc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc16 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781995.267744:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+50:11589:x1874625005966848:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 20393us (20717us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787781995.267755:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000020:00080000:0.0:1787781995.267761:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787781995.271740:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.271868:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005967104 00000100:00100000:3.0:1787781995.271881:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005967104 00000100:00100000:3.0:1787781995.271968:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:3.0:1787781995.271980:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+50:11589:x1874625005967104:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781995.272013:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781995.272053:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454de4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc1d expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.272268:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454de4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc1d expref: 51 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.272287:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454de4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc1d expref: 51 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.272314:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781995.272318:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781995.272322:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3e00, rc 0) 00000100:00100000:3.0:1787781995.272394:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+51:11589:x1874625005967104:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 415us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.272401:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:3.0:1787781995.276406:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781995.276606:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005967360 00000100:00100000:2.0:1787781995.276619:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005967360 00000100:00100000:2.0:1787781995.276730:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:2.0:1787781995.276742:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+51:11589:x1874625005967360:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787781995.277145:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+52:11589:x1874625005967360:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 403us (754us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787781995.277154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:1.0:1787781995.379842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.380050:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005967488 00000100:00100000:3.0:1787781995.380063:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005967488 00000100:00100000:3.0:1787781995.380160:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:3.0:1787781995.380173:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+52:11599:x1874625005967488:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:3.0:1787781995.380276:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380315:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380332:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380353:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380360:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380367:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380498:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380507:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380514:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787781995.380568:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380583:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380590:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380609:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380616:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781995.380620:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380630:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380645:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:3.0:1787781995.380648:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781995.380654:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380661:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454deb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380677:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380683:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380689:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380694:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781995.380697:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380713:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380722:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef44a7db700) 00010000:00010000:3.0:1787781995.380724:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781995.380727:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380733:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454df2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380748:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380755:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380760:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380766:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781995.380769:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380776:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380783:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781995.380785:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781995.380843:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.380860:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.380979:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+52:11599:x1874625005967488:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 806us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.380988:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:1.0:1787781995.419771:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781995.419943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005967744 00000100:00100000:2.0:1787781995.419956:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005967744 00000100:00100000:2.0:1787781995.420072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:2.0:1787781995.420093:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+52:11602:x1874625005967744:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781995.420122:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781995.420326:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc24 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420423:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420462:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420475:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420493:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420500:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420507:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420667:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420675:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420681:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781995.420691:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787781995.420889:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420898:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420905:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420918:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781995.420923:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420932:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.420945:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781995.420948:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781995.420953:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421099:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421118:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421187:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421195:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421200:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781995.421203:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421209:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421230:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef45088a700) 00010000:00010000:2.0:1787781995.421233:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781995.421235:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421241:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421292:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc24 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421307:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc24 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.421315:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787781995.421317:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781995.421320:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8200, rc 0) 00000100:00100000:2.0:1787781995.421409:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:11602:x1874625005967744:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1326us (1653us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787781995.421420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:0.0:1787781995.424687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.424906:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005967872 00000100:00100000:3.0:1787781995.424918:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005967872 00000100:00100000:3.0:1787781995.425296:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:3.0:1787781995.425308:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:11602:x1874625005967872:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1787781995.425401:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.425423:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.425437:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.425467:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.425476:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.425483:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.425490:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781995.425494:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.425525:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.425541:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781995.425544:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787781995.425550:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.425556:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.425654:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:11602:x1874625005967872:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 347us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.425663:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:1.0:1787781995.431521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781995.431620:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005968128 00000100:00100000:0.0:1787781995.431633:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005968128 00000100:00100000:0.0:1787781995.431702:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:0.0:1787781995.431712:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+54:11602:x1874625005968128:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1787781995.432737:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:11602:x1874625005968128:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 1017us (1219us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787781995.432748:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:1.0:1787781995.506265:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781995.506482:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005968384 00000100:00100000:2.0:1787781995.506496:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005968384 00000100:00100000:2.0:1787781995.506575:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:2.0:1787781995.506587:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:11612:x1874625005968384:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787781995.506620:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781995.506624:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787781995.506661:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3c00/0x3ad9816c90454da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc08 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.506705:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781995.506712:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781995.507336:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc2b expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.507478:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.507495:0:9081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc24 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.507505:0:9081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.507549:0:9081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc24 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.507565:0:9081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc24 expref: 55 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781995.507581:0:9081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023780736:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781995.507709:0:9081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787781995.512573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.512683:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005968512 00000100:00100000:3.0:1787781995.512694:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005968512 00010000:00010000:3.0:1787781995.512753:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc24 expref: 56 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.512828:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:3.0:1787781995.512840:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:2352:x1874625005968512:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781995.512860:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781995.512868:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc24 expref: 56 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.512884:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc24 expref: 56 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.512948:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781995.512953:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.512971:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.512980:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.513007:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781995.513072:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+56:2352:x1874625005968512:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 233us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.513091:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00010000:00010000:2.0:1787781995.513464:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc24 expref: 55 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781995.513486:0:9081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9081:1874625023780736:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781995.513527:0:9081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.513538:0:9081:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.513543:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781995.513567:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787781995.513806:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc2b expref: 56 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.513826:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc2b expref: 55 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.513835:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787781995.513838:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787781995.513841:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8600, rc 0) 00000100:00100000:2.0:1787781995.513882:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:11612:x1874625005968384:12345-192.168.202.56@tcp:101:bash.0 Request processed in 7298us (7632us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787781995.513891:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:3.0:1787781995.519675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781995.519834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005968768 00000100:00100000:0.0:1787781995.519848:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005968768 00000100:00100000:0.0:1787781995.520233:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:0.0:1787781995.520249:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+55:11612:x1874625005968768:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:0.0:1787781995.520659:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.520681:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.520717:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787781995.520825:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787781995.520856:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ce0d67b reply state 0000000025096567 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781995.520867:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787781995.521226:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+58:11612:x1874625005968768:12345-192.168.202.56@tcp:36:bash.0 Request processed in 979us (1564us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787781995.528534:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 208 00000020:00080000:0.0:1787781995.528551:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787781995.529862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1787781995.529955:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.529971:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.529980:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.529986:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781995.529993:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.530002:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.530024:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:0.0:1787781995.530037:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781995.530063:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.530070:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781995.530135:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005968896 00000100:00100000:0.0:1787781995.530147:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005968896 00000100:00100000:0.0:1787781995.530211:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00100000:0.0:1787781995.530223:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+57:11612:x1874625005968896:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1787781995.530256:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781995.530278:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454e46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc32 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.530389:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.530406:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc2b expref: 58 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.530415:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.530456:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc2b expref: 58 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.530471:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc2b expref: 58 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781995.530486:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44697a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023780864:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781995.530594:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef48182a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787781995.534175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781995.534371:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44697a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023780864:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781995.534410:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.534486:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005969024 00000100:00100000:3.0:1787781995.534495:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005969024 00010000:00010000:3.0:1787781995.534541:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc2b expref: 59 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.534584:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:3.0:1787781995.534594:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:2351:x1874625005969024:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781995.534614:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781995.534622:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc2b expref: 59 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.534635:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc2b expref: 59 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.534680:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc2b expref: 59 pid: 9081 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.534698:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781995.534703:0:8462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.534714:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.534723:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.534752:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787781995.534917:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.534925:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781995.534995:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787781995.535001:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787781995.535026:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.535064:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454e46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc32 expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.535092:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc32 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781995.535101:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:1.0:1787781995.535103:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787781995.535106:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031400, rc 0) 00000100:00100000:3.0:1787781995.535247:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+58:2351:x1874625005969024:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 653us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.535256:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:1.0:1787781995.535721:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+57:11612:x1874625005968896:12345-192.168.202.56@tcp:101:bash.0 Request processed in 5498us (5869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781995.535731:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00100000:2.0:1787781995.540613:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.540739:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005969280 00000100:00100000:3.0:1787781995.540756:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005969280 00000100:00100000:2.0:1787781995.541358:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:2.0:1787781995.541374:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+57:11612:x1874625005969280:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:2.0:1787781995.541695:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+58:11612:x1874625005969280:12345-192.168.202.56@tcp:35:bash.0 Request processed in 325us (1099us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787781995.541726:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:2.0:1787781995.593181:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781995.593334:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005969408 00000100:00100000:0.0:1787781995.593348:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005969408 00000100:00100000:0.0:1787781995.593423:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:0.0:1787781995.593435:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+58:11618:x1874625005969408:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787781995.593466:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781995.593494:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc39 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.593580:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454e5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.593597:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.593611:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781995.593691:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787781995.593696:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787781995.593723:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.593757:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454e54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc39 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.593857:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc39 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.593867:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:0.0:1787781995.593871:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787781995.593875:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030e00, rc 0) 00000100:00100000:0.0:1787781995.593956:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:11618:x1874625005969408:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 523us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781995.593973:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:1.0:1787781995.597241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781995.597327:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005969536 00000100:00100000:2.0:1787781995.597340:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005969536 00000100:00100000:2.0:1787781995.597414:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:2.0:1787781995.597426:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:11618:x1874625005969536:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787781995.597452:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781995.597479:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc40 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.597560:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.597576:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.597589:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.597606:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.597614:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.597621:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.597752:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.597778:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.597784:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787781995.598545:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787781995.598552:0:9081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781995.598580:0:9081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599290:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599305:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599313:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599320:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599326:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781995.599331:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599339:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599357:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781995.599360:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781995.599385:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599392:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90454e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599412:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599420:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599427:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599433:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781995.599436:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599441:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599450:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef45088a700) 00010000:00010000:2.0:1787781995.599452:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781995.599455:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599461:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8400/0x3ad9816c90454e70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599515:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8200/0x3ad9816c90454e62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc40 expref: 61 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599546:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc40 expref: 60 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.599554:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787781995.599556:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781995.599559:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8c00, rc 0) 00000100:00100000:2.0:1787781995.599750:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:11618:x1874625005969536:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2324us (2523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781995.599760:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:2.0:1787781995.604320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781995.604412:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.604485:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005969920 00000100:00100000:3.0:1787781995.604497:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005969920 00000100:00100000:3.0:1787781995.604578:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1787781995.604590:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:2351:x1874625005969920:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781995.604611:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781995.604642:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454e77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc40 expref: 60 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.604667:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781995.604691:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781995.604771:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:2351:x1874625005969920:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 183us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.604780:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1787781995.607957:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005969792 00000100:00100000:0.0:1787781995.608145:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005969792 00000100:00100000:0.0:1787781995.608261:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:0.0:1787781995.608274:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:11618:x1874625005969792:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787781995.608303:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781995.608333:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454e7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc47 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.608488:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.608506:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc32 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.608517:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.608563:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc32 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.608597:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc32 expref: 60 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781995.608614:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44697a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023780992:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781995.608814:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef48182a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787781995.614011:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781995.614593:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44697a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874625023780992:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781995.614630:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781995.614745:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005970048 00000100:00100000:3.0:1787781995.614755:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005970048 00010000:00010000:3.0:1787781995.614890:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc32 expref: 61 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781995.615195:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:2.0:1787781995.615209:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:2352:x1874625005970048:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781995.615228:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781995.615236:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc32 expref: 61 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.615249:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc32 expref: 61 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.615277:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc32 expref: 61 pid: 5835 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.615295:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787781995.615318:0:8462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.615328:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.615337:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781995.615373:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781995.615451:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:2352:x1874625005970048:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 246us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781995.615458:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 81 00010000:00010000:3.0:1787781995.615517:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.615525:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781995.615549:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787781995.615747:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454e7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc47 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.615765:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc47 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.615773:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781995.615776:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787781995.615779:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030c00, rc 0) 00000100:00100000:3.0:1787781995.615845:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:11618:x1874625005969792:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 7574us (11539us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787781995.615853:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:1.0:1787781995.619836:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.619963:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005970304 00000100:00100000:3.0:1787781995.619996:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005970304 00000100:00100000:3.0:1787781995.620093:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1787781995.620106:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:11618:x1874625005970304:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:3.0:1787781995.620129:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781995.620162:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454de4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc1d expref: 60 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.620184:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781995.620190:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781995.620260:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:11618:x1874625005970304:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 156us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.620269:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1787781995.622579:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781995.622968:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005970432 00000100:00100000:0.0:1787781995.622980:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005970432 00000100:00100000:0.0:1787781995.623070:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00100000:0.0:1787781995.623092:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:11618:x1874625005970432:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:0.0:1787781995.623252:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.623276:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781995.623290:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787781995.623518:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787781995.623637:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:11618:x1874625005970432:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 555us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781995.623654:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00100000:0.0:1787781995.626400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781995.626528:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005970560 00000100:00100000:3.0:1787781995.626541:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005970560 00000100:00100000:3.0:1787781995.626607:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 214 00000100:00100000:3.0:1787781995.626619:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44697a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+59:11618:x1874625005970560:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781995.626706:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781995.626733:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc4e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.626844:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.626857:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e9a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc4e expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.626880:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.626907:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e9a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc4e expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.626934:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781995.626938:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787781995.626942:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e9a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc4e expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781995.626950:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3000, rc 0) 00000100:00100000:3.0:1787781995.627025:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44697a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:11618:x1874625005970560:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 408us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781995.627041:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 214 00000001:00080000:0.0:1787781995.766565:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1787781995.766587:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1787781995.766597:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1787781995.766604:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1787781995.774326:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787781996.350175:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787781996.350189:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787781996.350264:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787781996.350273:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787781996.350447:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a6580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023781120:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787781996.350592:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448b676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781996.354370:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.354747:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005970688 00000100:00100000:1.0:1787781996.354759:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005970688 00000100:00100000:3.0:1787781996.354861:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a6580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023781120:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787781996.354872:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 215 00000100:00100000:1.0:1787781996.354884:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:11619:x1874625005970688:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787781996.354927:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787781996.355055:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:11619:x1874625005970688:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 173us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781996.355064:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 215 00000100:00100000:2.0:1787781996.361211:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.361371:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005970816 00000100:00100000:3.0:1787781996.361384:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005970816 00000100:00100000:3.0:1787781996.361470:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:3.0:1787781996.361483:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:11619:x1874625005970816:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787781996.361587:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361610:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361627:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361656:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361678:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361686:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361717:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361726:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361733:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781996.361780:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787781996.361786:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787781996.361827:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361840:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361848:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361855:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361862:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781996.361867:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361885:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361900:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:3.0:1787781996.361904:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781996.361910:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361916:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ea1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361934:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361940:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361946:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361951:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781996.361954:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361960:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.361968:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9ef44a7db100) 00010000:00010000:3.0:1787781996.361971:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781996.361974:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.362003:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ea8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.362033:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.362040:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.362047:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.362053:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781996.362056:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.362063:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.362082:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781996.362084:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781996.362088:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.362094:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454eaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781996.362193:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:11619:x1874625005970816:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 712us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781996.362202:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:0.0:1787781996.376414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.377753:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005971072 00000100:00100000:1.0:1787781996.377773:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005971072 00000100:00100000:1.0:1787781996.377890:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:1.0:1787781996.377904:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+60:11619:x1874625005971072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781996.377933:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781996.377963:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454eb6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc55 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378110:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378136:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378273:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781996.378287:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787781996.378470:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378479:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378487:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378494:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781996.378500:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378509:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378521:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:1.0:1787781996.378524:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787781996.378528:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378533:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454ebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378586:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454eb6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc55 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378607:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:1.0:1787781996.378609:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787781996.378612:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fe00/0x3ad9816c90454eb6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc55 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.378620:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183fe00, rc 0) 00000100:00100000:1.0:1787781996.378706:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:11619:x1874625005971072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 806us (2308us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787781996.378714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:0.0:1787781996.390471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.392184:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005971200 00000100:00100000:3.0:1787781996.392205:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005971200 00000100:00100000:3.0:1787781996.392308:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:3.0:1787781996.392320:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:11619:x1874625005971200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787781996.392404:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787781996.394157:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:11619:x1874625005971200:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 1824us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781996.394174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:2.0:1787781996.401171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.403359:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005971456 00000100:00100000:3.0:1787781996.403381:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005971456 00000100:00100000:3.0:1787781996.403488:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:3.0:1787781996.403500:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:11619:x1874625005971456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787781996.403529:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781996.403543:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787781996.403583:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc39 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.403609:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:3.0:1787781996.403617:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781996.404471:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454ecb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc5c expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787781996.405185:0:9081:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1787781996.405460:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.405481:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.405503:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.405579:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2600/0x3ad9816c90454ecb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc5c expref: 63 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.405602:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc5c expref: 62 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.405613:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef44a7db100) 00010000:00010000:3.0:1787781996.405617:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787781996.405622:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3800, rc 0) 00000100:00100000:3.0:1787781996.405714:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+62:11619:x1874625005971456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2215us (4558us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787781996.405725:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:0.0:1787781996.411084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.411174:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005971712 00000100:00100000:3.0:1787781996.411188:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005971712 00000100:00100000:3.0:1787781996.411262:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 220 00000100:00100000:3.0:1787781996.411273:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+62:11619:x1874625005971712:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787781996.411356:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781996.411391:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc5c expref: 62 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411425:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef44a7db100) 00010000:00010000:3.0:1787781996.411438:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781996.411464:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411498:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411510:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411528:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411548:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411555:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411665:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411674:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411680:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411686:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781996.411690:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411698:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411707:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:3.0:1787781996.411719:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781996.411724:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411732:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454ee0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411742:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411747:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411752:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411757:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781996.411760:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411766:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411773:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xaaead1c8 (ffff9ef44a7db700) 00010000:00010000:3.0:1787781996.411775:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787781996.411778:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.411785:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454ee7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaaead1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781996.411920:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:11619:x1874625005971712:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 648us (860us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787781996.411935:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 220 00000100:00100000:0.0:1787781996.422158:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.422300:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005971840 00000100:00100000:1.0:1787781996.422313:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005971840 00000100:00100000:1.0:1787781996.422411:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 221 00000100:00100000:1.0:1787781996.422424:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:11619:x1874625005971840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781996.422454:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781996.422485:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454eee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc63 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.422535:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.422553:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.422567:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.422699:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ee00/0x3ad9816c90454eee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc63 expref: 63 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.422729:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc63 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.422738:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:1.0:1787781996.422741:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787781996.422745:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e600, rc 0) 00000100:00100000:1.0:1787781996.422866:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+62:11619:x1874625005971840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 444us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781996.422874:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 221 00000100:00100000:1.0:1787781996.432984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.435928:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005972096 00000100:00100000:3.0:1787781996.435949:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005972096 00000100:00100000:3.0:1787781996.436049:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:3.0:1787781996.436060:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+62:11619:x1874625005972096:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787781996.436192:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.436213:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.436228:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787781996.439239:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787781996.439277:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364217487495ns, next at 365217482417ns, rc = 0 00000004:00010000:2.0:1787781996.439421:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000add31bf7 reply state 0000000059781b47 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781996.439435:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781996.439600:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+64:11619:x1874625005972096:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 3535us (6624us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787781996.439611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 222 00010000:00010000:3.0:1787781996.442929:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.442948:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.442955:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.442960:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787781996.442964:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.442971:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.443124:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:3.0:1787781996.443128:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787781996.443134:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.443142:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2400/0x3ad9816c90454efc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781996.448370:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.448460:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005972224 00000100:00100000:0.0:1787781996.448473:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005972224 00000100:00100000:0.0:1787781996.448558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:0.0:1787781996.448571:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+63:11619:x1874625005972224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781996.448605:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781996.448635:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc6a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.448719:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc6a expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.448736:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc6a expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.448760:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:0.0:1787781996.448763:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787781996.448768:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031400, rc 0) 00000100:00100000:0.0:1787781996.448880:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+64:11619:x1874625005972224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 311us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781996.448910:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:0.0:1787781996.452133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.452575:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005972352 00000100:00100000:3.0:1787781996.452586:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005972352 00000100:00100000:3.0:1787781996.452684:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:3.0:1787781996.452698:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2350:x1874625005972352:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787781996.453420:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:2350:x1874625005972352:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 721us (1297us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787781996.453431:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00080000:0.0:1787781996.454574:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787781996.455245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.455538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005972608 00000100:00100000:0.0:1787781996.455548:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005972608 00000100:00100000:0.0:1787781996.455661:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:0.0:1787781996.455672:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+64:11619:x1874625005972608:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787781996.456016:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+65:11619:x1874625005972608:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 345us (777us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787781996.456023:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:2.0:1787781996.458235:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.458481:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005972864 00000100:00100000:0.0:1787781996.458492:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005972864 00000100:00100000:0.0:1787781996.458561:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:0.0:1787781996.458571:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+65:11619:x1874625005972864:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787781996.458710:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+65:11619:x1874625005972864:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 140us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781996.458718:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:1.0:1787781996.461270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.461664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005972992 00000100:00100000:0.0:1787781996.461674:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005972992 00000100:00100000:0.0:1787781996.462892:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:0.0:1787781996.462927:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+65:11619:x1874625005972992:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781996.462956:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781996.462988:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc71 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.463134:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.463162:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.463176:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787781996.463222:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787781996.463246:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.463277:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc71 expref: 67 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.463299:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc71 expref: 66 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.463307:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:0.0:1787781996.463310:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787781996.463314:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030e00, rc 0) 00000100:00100000:0.0:1787781996.463423:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+66:11619:x1874625005972992:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 517us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781996.463431:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:1.0:1787781996.466698:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.466870:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005973120 00000100:00100000:0.0:1787781996.466880:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005973120 00000100:00100000:0.0:1787781996.467034:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:0.0:1787781996.467060:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+10:2351:x1874625005973120:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781996.467093:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781996.467121:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc78 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787781996.467164:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f636d, blocks: 0x1 00010000:00010000:0.0:1787781996.467195:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1787781996.467200:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781996.467212:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc78 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.467235:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc78 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.467251:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030a00, rc 0) 00000100:00100000:0.0:1787781996.467349:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:2351:x1874625005973120:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 291us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781996.467355:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:1.0:1787781996.472603:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.476282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005973376 00000100:00100000:3.0:1787781996.476303:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005973376 00000100:00100000:3.0:1787781996.476766:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:3.0:1787781996.476781:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+66:11619:x1874625005973376:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787781996.477024:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+66:11619:x1874625005973376:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 246us (4436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781996.477032:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:1.0:1787781996.482511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.482609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.482655:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.482691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.482864:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005973888 00000100:00100000:0.0:1787781996.482864:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005973632 00000100:00100000:1.0:1787781996.482876:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005973888 00000100:00100000:0.0:1787781996.482876:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005973632 00000100:00100000:2.0:1787781996.482931:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005973760 00000100:00100000:2.0:1787781996.482935:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005973760 00000100:00100000:0.0:1787781996.482950:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:0.0:1787781996.482960:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2349:x1874625005973632:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781996.482981:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:2.0:1787781996.482988:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2349:x1874625005973760:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787781996.483097:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2349:x1874625005973760:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 108us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781996.483106:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:0.0:1787781996.483120:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2349:x1874625005973632:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 161us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781996.483126:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:3.0:1787781996.483256:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005973504 00000100:00100000:3.0:1787781996.483262:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005973504 00000100:00100000:3.0:1787781996.483295:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:3.0:1787781996.483353:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2349:x1874625005973504:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787781996.483644:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2349:x1874625005973504:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781996.483654:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:0.0:1787781996.484864:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:0.0:1787781996.484882:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:11619:x1874625005973888:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787781996.484903:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781996.484926:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc7f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.484967:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc78 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.485108:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781996.485114:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787781996.485121:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.485784:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc78 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.486084:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc78 expref: 12 pid: 6697 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781996.486108:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480a043c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1874625023781248:192.168.202.56@tcp:104: 00000100:00080000:1.0:1787781996.486260:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781996.486611:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef48182ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781996.496440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.496567:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480a043c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1874625023781248:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787781996.496617:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.496667:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031600, rc 0) 00000100:00100000:2.0:1787781996.496925:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005974016 00000100:00100000:2.0:1787781996.496936:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005974016 00010000:00010000:2.0:1787781996.497239:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc78 expref: 13 pid: 6697 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781996.497288:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:0.0:1787781996.497289:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:11619:x1874625005973888:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 12412us (14595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781996.497298:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:2.0:1787781996.497299:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:2351:x1874625005974016:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781996.497318:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781996.497348:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc78 expref: 12 pid: 6697 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.497695:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc78 expref: 12 pid: 6697 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.497730:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c90454f18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc78 expref: 12 pid: 6697 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.497749:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781996.497754:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781996.497762:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.497873:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.497966:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781996.497993:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476aa30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1874625023781376:192.168.202.56@tcp:105: 00000100:00100000:2.0:1787781996.498089:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787781996.502064:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476aa30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1874625023781376:192.168.202.56@tcp:105: 00010000:00010000:2.0:1787781996.502118:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781996.502218:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:2351:x1874625005974016:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 4919us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781996.502233:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:1.0:1787781996.502534:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781996.502969:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005974144 00000100:00100000:2.0:1787781996.502979:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005974144 00002000:00100000:2.0:1787781996.503040:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9ef480bb4f00 x1874625005974144/t0(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:142/0 lens 504/0 e 0 to 0 dl 1787782007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781996.503053:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef480bb4f00 with x1874625005974144 ext(0->12) 00002000:00010000:2.0:1787781996.503060:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef480bb4f00 00000100:00100000:2.0:1787781996.503104:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1787781996.503115:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+11:2351:x1874625005974144:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787781996.503919:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:2351:x1874625005974144:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 798us (1379us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787781996.503940:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00002000:00100000:2.0:1787781996.503950:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9ef480bb4f00 x1874625005974144/t4294967320(0) o4->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:142/0 lens 504/448 e 0 to 0 dl 1787782007 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787781996.503959:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef480bb4f00 with x1874625005974144 ext(0->12) 00002000:00010000:2.0:1787781996.503963:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef480bb4f00 00000100:00100000:1.0:1787781996.506556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.507091:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005974272 00000100:00100000:0.0:1787781996.507104:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005974272 00000100:00100000:0.0:1787781996.507195:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 227 00000100:00100000:0.0:1787781996.507207:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+66:11619:x1874625005974272:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787781996.577632:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787781996.577688:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:1.0:1787781996.577908:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023781504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787781996.578021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781996.578125:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023781504 00000100:00100000:1.0:1787781996.578136:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023781504 00000100:00100000:1.0:1787781996.579256:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787781996.579268:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023781504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787781996.579306:0:8308:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1787781996.579340:0:8308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.579367:0:8308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbde expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.579378:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787781996.579384:0:8308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787781996.579389:0:8308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787781996.579510:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787781996.579600:0:8308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbde expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.579617:0:8308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbde expref: 12 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781996.579632:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023781632:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781996.579782:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448b67480 going to sleep for 11 seconds 00000100:00100000:0.0:1787781996.580255:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+61:11619:x1874625005974272:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 73048us (73711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781996.580266:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 227 00000020:00080000:3.0:1787781996.580436:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef442d18780 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787781996.580442:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef473c65000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef442d18180 00000020:00080000:3.0:1787781996.580446:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef473c65f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef476ce4800 00000004:00080000:3.0:1787781996.580479:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1787781996.580560:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787781996.580582:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef4459340c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787781996.580586:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef478c39d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef445934d80 00000020:00080000:3.0:1787781996.580589:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef478c39400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef478f92400 00000020:00080000:0.0:1787781996.580951:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787781996.581445:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787781996.581460:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787781996.581482:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023781760:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787781996.581558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781996.581727:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023781760 00000100:00100000:3.0:1787781996.581743:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023781760 00000100:00100000:3.0:1787781996.581825:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787781996.581836:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023781760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787781996.581867:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1787781996.581921:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f636c, atime: 0x6a8f636c, ctime: 0x6a8f636c, blocks: 0xb 00010000:00010000:3.0:1787781996.581930:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.581950:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1787781996.581955:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781996.581964:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.582020:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.582031:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.582038:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.582058:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787781996.583300:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781996.583312:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.583327:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787781996.583332:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.583344:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.583369:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.583378:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c90454f2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.583403:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781996.583406:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781996.583407:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787781996.583494:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787781996.583512:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023781888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787781996.583582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781996.583636:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787781996.583646:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787781996.583837:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023781888 00000100:00100000:1.0:1787781996.583843:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023781888 00000100:00100000:1.0:1787781996.584351:0:12536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787781996.584362:0:12536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a763c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3305:x1874625023781888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787781996.584577:0:12536:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787781996.584581:0:12536:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787781997 00002000:00010000:1.0:1787781996.584584:0:12536:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787781996.584587:0:12536:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787781997 -> 1787781997 00002000:00010000:1.0:1787781996.584589:0:12536:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787781996.584659:0:12536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a763c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3305:x1874625023781888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 300us (1076us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787781996.584668:0:12536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1787781996.584724:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef44a7612c0/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787781996.585439:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625023781760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3601us (3877us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787781996.585449:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787781996.585528:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023781888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787781996.587225:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787781996.587240:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:0.0:1787781996.587272:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef476bb4b40, transno 4294967307 00000004:00080000:0.0:1787781996.587340:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1787781996.587363:0:3306:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ef478a7b480 x1874625023781760/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787782012 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787781996.587378:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef478a7b480/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787781996.589760:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023781760:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787781996.592397:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8308:1874625023781632:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787781996.592440:0:8308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781996.592605:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.592661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781996.592747:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005974400 00000100:00100000:2.0:1787781996.592755:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005974400 00000100:00100000:2.0:1787781996.592846:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:2.0:1787781996.592856:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:2351:x1874625005974400:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787781996.593625:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005974528 00000100:00100000:3.0:1787781996.593635:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005974528 00010000:00010000:3.0:1787781996.593674:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbde expref: 14 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781996.593721:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:3.0:1787781996.593730:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+14:2352:x1874625005974528:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781996.593753:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781996.593761:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbde expref: 14 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.593777:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbde expref: 14 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.593850:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df8a5380/0x3ad9816c90454ce8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbde expref: 14 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.593871:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781996.593876:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781996.593882:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.593894:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.593931:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787781996.593965:0:8308:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.593975:0:8308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.593988:0:8308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.593996:0:8308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.594016:0:8308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787781996.595252:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1874625023781504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15980us (17226us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787781996.595265:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1787781996.595300:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787781996.595308:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.595321:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ee00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781996.595327:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.595339:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.595359:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.595368:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022649736/0x3ad9816c90454f26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.595390:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781996.595392:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787781996.595394:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787781996.595454:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+13:2352:x1874625005974528:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1723us (2790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781996.595462:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 83 00000004:00080000:0.0:1787781996.595539:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef480bb61c0/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787781996.595548:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023781504:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787781996.632363:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1787781996.632390:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1787781996.632610:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2351:x1874625005974400:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 39745us (39996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781996.632647:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:1.0:1787781996.636326:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781996.636557:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005974784 00000100:00100000:2.0:1787781996.636569:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005974784 00000100:00100000:2.0:1787781996.636677:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:2.0:1787781996.636690:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:11619:x1874625005974784:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787781996.636775:0:9081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781996.636856:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc71 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.636883:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:2.0:1787781996.636889:0:9081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781996.636953:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.636971:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.636984:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787781996.637462:0:9081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f122a0d reply state 00000000618972e4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781996.637474:0:9081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787781996.637740:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:11619:x1874625005974784:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1049us (1425us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787781996.637750:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 228 00010000:00010000:0.0:1787781996.640520:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.640546:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.640555:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.640561:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781996.640567:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.640576:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.640598:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:0.0:1787781996.640601:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787781996.640606:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.640612:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90454f34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781996.642938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.643356:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005974912 00000100:00100000:3.0:1787781996.643369:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005974912 00000100:00100000:3.0:1787781996.643484:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:3.0:1787781996.643497:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2351:x1874625005974912:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787781996.643832:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787781996.643836:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787781997 -> 1787781996 00002000:00010000:3.0:1787781996.643839:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787781996 00002000:00010000:3.0:1787781996.643842:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787781997 -> 1787781996 00002000:00010000:3.0:1787781996.643845:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787781996.643941:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005974912:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 446us (1020us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787781996.643951:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:2.0:1787781996.645985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.646133:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005975168 00000100:00100000:3.0:1787781996.646144:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005975168 00000100:00100000:3.0:1787781996.646210:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:3.0:1787781996.646221:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:11619:x1874625005975168:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787781996.646307:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.646331:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc63 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.646342:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.646411:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc63 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.646428:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc63 expref: 20 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781996.646446:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023782016:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781996.646553:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef34316f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787781996.648454:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874625023782016:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781996.648491:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781996.649347:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.649417:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005975296 00000100:00100000:3.0:1787781996.649423:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005975296 00010000:00010000:3.0:1787781996.649462:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc63 expref: 21 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781996.649498:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:3.0:1787781996.649509:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:2352:x1874625005975296:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787781996.649529:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787781996.649537:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc63 expref: 21 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.649551:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc63 expref: 21 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.649602:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e600/0x3ad9816c90454ef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc63 expref: 21 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.649618:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:3.0:1787781996.649624:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.649634:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.649643:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.649915:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787781996.649986:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:2352:x1874625005975296:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 476us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781996.650006:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 84 00010000:00010000:0.0:1787781996.650185:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.650208:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.650244:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.650251:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.650258:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.650265:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787781996.650271:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.650280:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.650290:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:0.0:1787781996.650294:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787781996.650298:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.650304:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2c00/0x3ad9816c90454f3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781996.650352:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476aa30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11619:x1874625005975168:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 4133us (4380us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787781996.650361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:0.0:1787781996.652240:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.652290:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005975424 00000100:00100000:3.0:1787781996.652301:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005975424 00000100:00100000:3.0:1787781996.652358:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:3.0:1787781996.652367:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44693b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2350:x1874625005975424:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787781996.652419:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.652438:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.652462:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787781996.652466:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787781996.652470:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.652509:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.652525:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 8 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781996.652543:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef476bb4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1874625023782144:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787781996.652642:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef34316f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787781996.654939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.655254:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005975552 00000100:00100000:0.0:1787781996.655264:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005975552 00010000:00010000:0.0:1787781996.655314:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 9 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781996.655357:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:0.0:1787781996.655369:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2351:x1874625005975552:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781996.655388:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781996.655415:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 9 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.655431:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 9 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.655463:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781996.655468:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787781996.655475:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.655488:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.655516:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787781996.655593:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+9:2351:x1874625005975552:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 225us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781996.655602:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 85 00010000:00010000:3.0:1787781996.656209:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f661715/0x3ad9816c90454f1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc7f expref: 8 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781996.656227:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef476bb4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1874625023782144:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787781996.656248:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.656257:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.656262:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.656298:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.656305:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.656310:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.656315:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787781996.656318:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.656325:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.656336:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781996.656340:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000961bf01c/0x3ad9816c90454f42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787781996.656392:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44693b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2350:x1874625005975424:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 4028us (4164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781996.656398:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:0.0:1787781996.658724:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.658924:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005975808 00000100:00100000:1.0:1787781996.658937:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005975808 00000100:00100000:1.0:1787781996.659079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:1.0:1787781996.659092:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479149a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11619:x1874625005975808:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787781996.659201:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.659224:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.659239:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.659504:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.659517:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc6a expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.659526:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.659567:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc6a expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.659581:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc6a expref: 20 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781996.659595:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023782272:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787781996.659688:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448b67780 going to sleep for 11 seconds 00000100:00100000:1.0:1787781996.661619:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023782272:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787781996.661649:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781996.662431:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781996.662488:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005975936 00000100:00100000:2.0:1787781996.662495:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005975936 00010000:00010000:2.0:1787781996.662543:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc6a expref: 21 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781996.662583:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:2.0:1787781996.662594:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:2352:x1874625005975936:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787781996.662610:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787781996.662616:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc6a expref: 21 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.662627:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc6a expref: 21 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.662669:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc6a expref: 21 pid: 5835 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.662684:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:2.0:1787781996.662688:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.662695:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.662701:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.662725:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787781996.662775:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:2352:x1874625005975936:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 183us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781996.662780:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 86 00010000:00010000:1.0:1787781996.663126:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.663133:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787781996.663351:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787781996.663488:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787781996.663531:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787781996.663619:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023782400:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787781996.663667:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781996.663704:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448b67480 going to sleep for 11 seconds 00000100:00100000:2.0:1787781996.664208:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023782400 00000100:00100000:2.0:1787781996.664216:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023782400 00000100:00100000:2.0:1787781996.664308:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787781996.664319:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874625023782400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787781996.664423:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874625023782400:12345-0@lo:1000:mdt00_002.0 Request processed in 106us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781996.664431:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787781996.664501:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1787781996.664510:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1787781996.664534:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef44a7612c0, transno 4294967321 00000100:00100000:1.0:1787781996.664559:0:5835:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ef480bb61c0 x1874625023781504/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787782012 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787781996.664573:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023782400:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787781996.665172:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787781996.665254:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023782528:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787781996.665300:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787781996.665760:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781996.665786:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023782528 00000100:00100000:0.0:1787781996.665825:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023782528 00000100:00100000:0.0:1787781996.665857:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787781996.665865:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1874625023782528:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787781996.666233:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5835:x1874625023782528:12345-0@lo:1000:mdt00_002.0 Request processed in 368us (932us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787781996.666240:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787781996.666296:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874625023782528:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787781996.666331:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666338:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666344:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666348:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781996.666352:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666368:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666383:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef448467100) 00010000:00010000:1.0:1787781996.666385:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787781996.666389:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666394:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f50 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666423:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666427:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666431:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666434:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781996.666436:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666439:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666443:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:1.0:1787781996.666445:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787781996.666450:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc4e expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666466:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc4e expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666473:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc4e expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.666497:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc4e expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781996.666510:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023782656:192.168.202.56@tcp:105: 00000100:00100000:1.0:1787781996.666610:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787781996.669459:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781996.669641:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005976064 00000100:00100000:2.0:1787781996.669653:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005976064 00000100:00100000:2.0:1787781996.669726:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:2.0:1787781996.669737:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11618:x1874625005976064:12345-192.168.202.56@tcp:49:lfs.0 00000100:00100000:2.0:1787781996.669955:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11618:x1874625005976064:12345-192.168.202.56@tcp:49:lfs.0 Request processed in 218us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781996.669964:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:0.0:1787781996.672085:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.672179:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005976320 00000100:00100000:3.0:1787781996.672189:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005976320 00000100:00100000:3.0:1787781996.672256:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:3.0:1787781996.672267:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11618:x1874625005976320:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:3.0:1787781996.672760:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787781996.673397:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11618:x1874625005976320:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 1127us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781996.673410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:1.0:1787781996.673613:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023782656:192.168.202.56@tcp:105: 00010000:00010000:1.0:1787781996.673650:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673662:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454e93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673708:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673727:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673740:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673752:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673770:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673778:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673786:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781996.673809:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673818:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673832:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:1.0:1787781996.673835:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787781996.673839:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673845:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e800/0x3ad9816c90454f57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673856:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673863:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673869:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673873:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781996.673882:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673888:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673897:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:1.0:1787781996.673899:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787781996.673902:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.673908:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f800/0x3ad9816c90454f49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781996.674113:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479149a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:11619:x1874625005975808:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 15022us (15403us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787781996.674121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 230 00000020:00080000:1.0:1787781996.674125:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787781996.674316:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787781996.674323:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787781996.674356:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787781996.674363:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781996.674494:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a61c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023782784:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787781996.674561:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787781996.677839:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781996.677987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.678087:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005976704 00000100:00100000:1.0:1787781996.678099:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005976704 00000100:00100000:1.0:1787781996.678170:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:1.0:1787781996.678181:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11622:x1874625005976704:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787781996.678223:0:9081:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787781996.678353:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+24:11622:x1874625005976704:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 173us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787781996.678362:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:0.0:1787781996.678732:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a61c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1874625023782784:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787781996.683429:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.683512:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005976960 00000100:00100000:1.0:1787781996.683522:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005976960 00000100:00100000:1.0:1787781996.683581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:1.0:1787781996.683589:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:11622:x1874625005976960:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787781996.683630:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787781996.683652:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454f5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc86 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.683765:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454f65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.683780:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.683823:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787781996.683834:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787781996.684208:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ea00/0x3ad9816c90454f5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc86 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.684230:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc86 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.684240:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:1.0:1787781996.684243:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787781996.684247:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e400, rc 0) 00000100:00100000:1.0:1787781996.684332:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:11622:x1874625005976960:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 742us (915us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1787781996.684340:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:2.0:1787781996.685049:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005976576 00000100:00100000:2.0:1787781996.685059:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005976576 00000100:00100000:2.0:1787781996.685126:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:2.0:1787781996.685137:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+25:11619:x1874625005976576:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787781996.686454:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787781996.687263:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1787781996.687415:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.687438:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.687453:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.687464:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.687471:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.687486:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.688046:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787781996.688097:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787781996.688108:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.688131:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8a00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787781996.688136:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.688146:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.688163:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:1.0:1787781996.688167:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787781996.688172:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.688178:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c90454f73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.688202:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781996.688205:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781996.688208:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:11619:x1874625005976576:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 3064us (10415us total) trans 4294967515 rc 0/0 00010000:00010000:1.0:1787781996.688208:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781996.688221:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000020:00080000:2.0:1787781996.688229:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787781996.689755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787781996.689939:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005977216 00000100:00100000:1.0:1787781996.689951:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005977216 00000100:00100000:1.0:1787781996.690039:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:1.0:1787781996.690052:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+27:11622:x1874625005977216:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787781996.690159:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.690181:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.690196:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.690477:0:9081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.690485:0:9081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.690492:0:9081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.690498:0:9081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787781996.690502:0:9081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.690510:0:9081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.690525:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:1.0:1787781996.690528:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787781996.690533:0:9081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787781996.690539:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f200/0x3ad9816c90454f7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787781996.690726:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:11622:x1874625005977216:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 676us (981us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787781996.690736:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 234 00000040:00080000:0.0:1787781996.691166:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787781996.691174:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787781996.691691:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787781996.691700:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787781996.695659:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781996.695767:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005977472 00000100:00100000:2.0:1787781996.695782:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005977472 00000100:00100000:2.0:1787781996.695906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:2.0:1787781996.695927:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478b343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+28:11622:x1874625005977472:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787781996.696283:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478b343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:11622:x1874625005977472:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 356us (636us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787781996.696293:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:2.0:1787781996.699437:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.699507:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005977600 00000100:00100000:0.0:1787781996.699517:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005977600 00000100:00100000:0.0:1787781996.699612:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:0.0:1787781996.699621:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+29:11624:x1874625005977600:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787781996.699647:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787781996.699669:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454f81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc8d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.699759:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.699775:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.699786:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.699826:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.699835:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.699840:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.700218:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.700228:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc47 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.700234:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.700271:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc47 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.700291:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc47 expref: 30 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781996.700304:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023782912:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787781996.700402:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef48182ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787781996.702346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781996.702395:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005977856 00000100:00100000:2.0:1787781996.702406:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005977856 00000100:00100000:0.0:1787781996.702448:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874625023782912:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787781996.702477:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00010000:00010000:0.0:1787781996.702481:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781996.702487:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:5586:x1874625005977856:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787781996.702747:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:5586:x1874625005977856:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 260us (408us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787781996.702755:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:2.0:1787781996.704211:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787781996.704269:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005977984 00000100:00100000:0.0:1787781996.704276:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005977984 00010000:00010000:0.0:1787781996.704312:0:8462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc47 expref: 32 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781996.704345:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:0.0:1787781996.704352:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:2351:x1874625005977984:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787781996.704365:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787781996.704370:0:8462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc47 expref: 32 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.704381:0:8462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc47 expref: 32 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.704403:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454e85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc47 expref: 32 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.704439:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:0.0:1787781996.704444:0:8462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.704452:0:8462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.704459:0:8462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787781996.704486:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787781996.704515:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704530:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787781996.704546:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+31:2351:x1874625005977984:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 193us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781996.704553:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00000004:00200000:2.0:1787781996.704583:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787781996.704589:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787781996.704611:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704625:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704636:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704642:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704649:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704655:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781996.704660:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704667:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704677:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787781996.704680:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781996.704684:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704700:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031600/0x3ad9816c90454f88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704712:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704719:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704725:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704730:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781996.704733:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704739:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704747:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ef44a9a7e00) 00010000:00010000:2.0:1787781996.704750:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787781996.704753:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704759:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90454f8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704862:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030a00/0x3ad9816c90454f81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc8d expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704880:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc8d expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781996.704898:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787781996.704901:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787781996.704904:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030e00, rc 0) 00000100:00100000:2.0:1787781996.704945:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:11624:x1874625005977600:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 5325us (5520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781996.704954:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 235 00010000:00010000:2.0:1787781996.798224:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787781997.388523:0:12574:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787781997.388533:0:12574:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787781997.388583:0:12574:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787781997.388591:0:12574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787781997.562602:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781997.562708:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005978240 00000100:00100000:3.0:1787781997.562722:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005978240 00000100:00100000:3.0:1787781997.562855:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:3.0:1787781997.562869:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44aa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+30:11647:x1874625005978240:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787781997.562902:0:9081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787781997.562930:0:9081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454f9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc94 expref: -99 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787781997.563029:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787781997.563857:0:9081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454fa4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.563880:0:9081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.563897:0:9081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787781997.563929:0:9081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787781997.564150:0:9081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3800/0x3ad9816c90454f9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc94 expref: 33 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.564170:0:9081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454fa4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc94 expref: 32 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787781997.564189:0:9081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:3.0:1787781997.564194:0:9081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787781997.564198:0:9081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3e00, rc 0) 00000100:00100000:3.0:1787781997.564285:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44aa3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11647:x1874625005978240:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1418us (1693us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787781997.564296:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:3.0:1787781997.569572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781997.572768:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005978368 00000100:00100000:2.0:1787781997.572814:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005978368 00000100:00100000:2.0:1787781997.573221:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 237 00000100:00100000:2.0:1787781997.573231:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11647:x1874625005978368:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1787781997.573321:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.573345:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.573359:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.573388:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.573394:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.573415:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.573420:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787781997.573423:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.573429:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.573440:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787781997.573442:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787781997.573446:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.573451:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c90454fb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787781997.573536:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:11647:x1874625005978368:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 306us (3981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781997.573541:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 237 00000100:00100000:3.0:1787781997.679729:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787781997.679859:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005978496 00000100:00100000:2.0:1787781997.679872:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005978496 00000100:00100000:2.0:1787781997.679952:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:2.0:1787781997.679966:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2351:x1874625005978496:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1787781997.679994:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787781997.680023:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006572bf06/0x3ad9816c90454fb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dc9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787781997.680096:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f636c, atime: 0x6a8f636c, ctime: 0x6a8f636c, blocks: 0xb 00010000:00010000:2.0:1787781997.680124:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787781997.680935:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787781997.680955:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006572bf06/0x3ad9816c90454fb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc9b expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.680983:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006572bf06/0x3ad9816c90454fb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc9b expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787781997.681000:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9000, rc 0) 00000100:00100000:2.0:1787781997.681275:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2351:x1874625005978496:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1309us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781997.681284:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:2.0:1787781997.685497:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787781997.685738:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005978624 00000100:00100000:3.0:1787781997.685752:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005978624 00002000:00100000:0.0:1787781997.686354:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9ef476f09a40 x1874625005978624/t0(0) o3->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:143/0 lens 488/0 e 0 to 0 dl 1787782008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787781997.686369:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef476f09a40 with x1874625005978624 ext(0->4095) 00002000:00010000:0.0:1787781997.686377:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef476f09a40 00000100:00100000:0.0:1787781997.686448:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1787781997.686461:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2349:x1874625005978624:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:0.0:1787781997.686761:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476f09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2349:x1874625005978624:12345-192.168.202.56@tcp:3:cat.0 Request processed in 301us (1277us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787781997.686770:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00002000:00100000:0.0:1787781997.686778:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9ef476f09a40 x1874625005978624/t0(0) o3->3fd2e199-5730-414f-9ae9-e4e10b451cbf@192.168.202.56@tcp:143/0 lens 488/4536 e 0 to 0 dl 1787782008 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787781997.686850:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ef476f09a40 with x1874625005978624 ext(0->4095) 00002000:00010000:0.0:1787781997.686853:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ef476f09a40 00000100:00100000:0.0:1787781997.758385:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023783040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781997.758495:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781997.760533:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023783040 00000100:00100000:3.0:1787781997.760549:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023783040 00000100:00100000:3.0:1787781997.760668:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787781997.760681:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874625023783040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787781997.760717:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787781997.760849:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874625023783040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (2354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781997.760856:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787781997.761349:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023783040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787781997.762917:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023783296:0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781997.763047:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787781997.763054:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023783424:0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781997.763129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023783296 00000100:00100000:0.0:1787781997.763137:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023783296 00000100:00100000:0.0:1787781997.763199:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023783424 00000100:00100000:0.0:1787781997.763202:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023783424 00000100:00100000:0.0:1787781997.763236:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787781997.763244:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023783296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763300:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023783296:12345-0@lo:400:kworker.0 Request processed in 57us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781997.763308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787781997.763327:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787781997.763333:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023783424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763365:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023783424:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781997.763370:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1787781997.763411:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781997.763447:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023783424:0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763458:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023783296:0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763484:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023783552:0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763514:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781997.763536:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787781997.763542:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023783168:0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781997.763602:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef450d6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023783680:0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787781997.763821:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023783168 00000100:00100000:0.0:1787781997.763825:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023783168 00000100:00100000:0.0:1787781997.763857:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787781997.763864:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023783168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.763907:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3303:x1874625023783168:12345-0@lo:400:kworker.0 Request processed in 43us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781997.763914:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787781997.763944:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023783680 00000100:00100000:0.0:1787781997.763947:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023783680 00000100:00100000:0.0:1787781997.763971:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787781997.763977:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023783680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.764007:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023783680:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787781997.764012:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1787781997.764026:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787781997.764047:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023783168:0@lo:400:kworker.0 00000100:00100000:0.0:1787781997.764080:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef450d6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023783680:0@lo:400:kworker.0 00000100:00100000:2.0:1787781997.764820:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023783552 00000100:00100000:2.0:1787781997.764829:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023783552 00000100:00100000:2.0:1787781997.764872:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787781997.764880:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625023783552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787781997.764949:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625023783552:12345-0@lo:400:kworker.0 Request processed in 71us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787781997.764955:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787781997.765078:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787781997.765119:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023783552:0@lo:400:kworker.0 00010000:00010000:3.0:1787781997.822320:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787781998.274538:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787781998.274573:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023783808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787781998.274673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787781998.276207:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023783808 00000100:00100000:3.0:1787781998.276223:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023783808 00000100:00100000:3.0:1787781998.276305:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787781998.276317:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625023783808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787781998.276369:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787781998.277220:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480a061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625023783808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 901us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787781998.277231:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787781998.290638:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023783808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787781998.851731:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787781999.870009:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782000.894332:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787782000.960914:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1787782001.607143:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782001.607187:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782001.607220:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782001.607242:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782001.607263:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782001.607306:0:12536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005979008 00000100:00100000:3.0:1787782001.607318:0:12536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005979008 00000100:00100000:3.0:1787782001.607392:0:12536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005979136 00000100:00100000:3.0:1787782001.607395:0:12536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005979136 00000100:00100000:3.0:1787782001.607420:0:12536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:3.0:1787782001.607446:0:12536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005979008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787782001.607544:0:12536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2350:x1874625005979008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 114us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782001.607553:0:12536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:3.0:1787782001.607572:0:12536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:3.0:1787782001.607580:0:12536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2350:x1874625005979136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787782001.607857:0:12536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fd2e199-5730-414f-9ae9-e4e10b451cbf+8:2350:x1874625005979136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 277us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782001.607877:0:12536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:0.0:1787782001.609301:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005978752 00000100:00100000:0.0:1787782001.609313:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005978752 00000100:00100000:0.0:1787782001.609380:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 298 00000100:00100000:0.0:1787782001.609389:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005978752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787782001.609463:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005978752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 77us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782001.609472:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 298 00000100:00100000:0.0:1787782001.609512:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005979264 00000100:00100000:0.0:1787782001.609516:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005979264 00000100:00100000:0.0:1787782001.609552:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005978880 00000100:00100000:0.0:1787782001.609555:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005978880 00000100:00100000:0.0:1787782001.609573:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 149 00000100:00100000:0.0:1787782001.609580:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47677b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005979264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787782001.609613:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47677b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2350:x1874625005979264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782001.609620:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 149 00000100:00100000:0.0:1787782001.609632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 150 00000100:00100000:0.0:1787782001.609638:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:2350:x1874625005978880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787782001.609664:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+32:2350:x1874625005978880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782001.609671:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 150 00000100:00080000:0.0:1787782001.609707:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782001.609712:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782001.609715:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787782001.929098:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787782001.929230:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1787782001.929248:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000020:00080000:2.0:1787782001.962389:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1787782001.962420:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:0.0:1787782001.962429:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1787782001.962437:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ef448b67840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787782001.962443:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef47faf8100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ef460ed2480 00000020:00080000:2.0:1787782001.962447:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ef47faf8000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ef478f92400 00000001:00080000:2.0:1787782001.962464:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:2.0:1787782001.962481:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787782001.962508:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787782001.962737:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1787782002.287401:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782002.287490:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005979392 00000100:00100000:3.0:1787782002.287502:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005979392 00000100:00100000:3.0:1787782002.287581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 238 00000100:00100000:3.0:1787782002.287602:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11307:x1874625005979392:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787782002.287738:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11307:x1874625005979392:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 137us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.287747:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 238 00000100:00100000:2.0:1787782002.295328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782002.297821:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005979648 00000100:00100000:1.0:1787782002.297842:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005979648 00000100:00100000:1.0:1787782002.297929:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:1.0:1787782002.297943:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:11307:x1874625005979648:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787782002.299838:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:11307:x1874625005979648:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1884us (4511us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787782002.299855:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:3.0:1787782002.566714:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782002.566852:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005979776 00000100:00100000:0.0:1787782002.566866:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005979776 00000100:00100000:0.0:1787782002.566949:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 239 00000100:00100000:0.0:1787782002.566961:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:12099:x1874625005979776:12345-192.168.202.56@tcp:101:lsof.0 00010000:00010000:0.0:1787782002.566988:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782002.567029:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dca2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782002.567118:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454fc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782002.567138:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782002.567155:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782002.567418:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787782002.567422:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782002.567490:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782002.567524:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90454fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dca2 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782002.567554:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dca2 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782002.567561:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467200) 00010000:00010000:0.0:1787782002.567565:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782002.567568:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030c00, rc 0) 00000100:00100000:0.0:1787782002.567643:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4791c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:12099:x1874625005979776:12345-192.168.202.56@tcp:101:lsof.0 Request processed in 685us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782002.567650:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 239 00000100:00100000:2.0:1787782002.879729:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f557840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023784192:0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.879875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782002.879955:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787782002.879961:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023784064:0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.879983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782002.880001:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f555e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023784576:0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.880035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782002.880070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023784192 00000100:00100000:2.0:1787782002.880078:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023784192 00000100:00100000:2.0:1787782002.880130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023784064 00000100:00100000:2.0:1787782002.880133:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023784064 00000100:00100000:2.0:1787782002.880151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787782002.880161:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023784192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.880216:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023784192:12345-0@lo:400:kworker.0 Request processed in 55us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782002.880223:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787782002.880239:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787782002.880245:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023784064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.880275:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023784064:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782002.880281:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787782002.880301:0:8308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023784576 00000100:00100000:2.0:1787782002.880303:0:8308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023784576 00000100:00100000:2.0:1787782002.880330:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787782002.880336:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023784576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.880361:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023784576:12345-0@lo:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782002.880368:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787782002.880382:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782002.880387:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782002.880424:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023784064:0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.880434:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1787782002.880440:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef480bb61c0, transno 4294967322 00000004:00080000:2.0:1787782002.880449:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1787782002.880474:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f555e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023784576:0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.880483:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f557840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023784192:0@lo:400:kworker.0 00000100:00100000:0.0:1787782002.880636:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f5552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023784320:0@lo:400:kworker.0 00000100:00100000:0.0:1787782002.880669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782002.880698:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787782002.880704:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023783936:0@lo:400:kworker.0 00000100:00100000:0.0:1787782002.880728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782002.880749:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f557c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023784448:0@lo:400:kworker.0 00000100:00100000:0.0:1787782002.880768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782002.880819:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023783936 00000100:00100000:0.0:1787782002.880823:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023783936 00000100:00100000:0.0:1787782002.880850:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787782002.880866:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023783936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782002.880900:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023783936:12345-0@lo:400:kworker.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782002.880906:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787782002.880940:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef480bb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023783936:0@lo:400:kworker.0 00000100:00100000:0.0:1787782002.880975:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023784448 00000100:00100000:0.0:1787782002.880979:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023784448 00000100:00100000:0.0:1787782002.881005:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787782002.881010:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023784448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782002.881050:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023784448:12345-0@lo:400:kworker.0 Request processed in 40us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782002.881056:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1787782002.881071:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782002.881085:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f557c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023784448:0@lo:400:kworker.0 00000100:00100000:0.0:1787782002.881137:0:12536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023784320 00000100:00100000:0.0:1787782002.881141:0:12536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023784320 00000100:00100000:0.0:1787782002.881169:0:12536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787782002.881175:0:12536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef450d6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023784320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782002.881206:0:12536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef450d6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023784320:12345-0@lo:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782002.881213:0:12536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787782002.881227:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782002.881238:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787782002.881243:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef478a7b480, transno 4294967310 00000100:00100000:0.0:1787782002.881254:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f5552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023784320:0@lo:400:kworker.0 00000100:00100000:2.0:1787782002.882360:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023784704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782002.882421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782002.882604:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023784704 00000100:00100000:3.0:1787782002.882612:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023784704 00000100:00100000:3.0:1787782002.882701:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787782002.882710:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023784704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782002.882747:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782002.882833:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023784704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782002.882840:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787782002.882915:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023784704:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787782002.942152:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782003.390527:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023784832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782003.390635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782003.390824:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023784832 00000100:00100000:2.0:1787782003.390834:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023784832 00000100:00100000:2.0:1787782003.390905:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787782003.390918:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023784832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787782003.390965:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782003.392535:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023784832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1607us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782003.392552:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787782003.396981:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023784832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782003.966315:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787782004.863945:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787782004.863972:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787782004.864097:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787782004.864105:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787782004.990275:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787782005.918777:0:12779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:06:45 (1787782005) 00010000:00010000:0.0:1787782006.016254:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782006.723328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782006.723366:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782006.723393:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782006.723410:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782006.723448:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782006.723474:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005980416 00000100:00100000:0.0:1787782006.723484:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005980416 00000100:00100000:0.0:1787782006.723536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:0.0:1787782006.723545:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:2349:x1874625005980416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787782006.723617:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:2349:x1874625005980416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782006.723624:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:0.0:1787782006.723642:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005980032 00000100:00100000:0.0:1787782006.723645:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005980032 00000100:00100000:0.0:1787782006.723664:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:0.0:1787782006.723670:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:2349:x1874625005980032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787782006.723702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:2349:x1874625005980032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782006.723707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00080000:0.0:1787782006.723722:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782006.724012:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005980160 00000100:00100000:2.0:1787782006.724017:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005980160 00000100:00100000:2.0:1787782006.724063:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005980288 00000100:00100000:2.0:1787782006.724067:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005980288 00000100:00100000:2.0:1787782006.724090:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:2.0:1787782006.724097:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef480bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2349:x1874625005980160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782006.724133:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef480bb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2349:x1874625005980160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782006.724138:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:2.0:1787782006.724151:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:2.0:1787782006.724250:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2349:x1874625005980288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782006.724279:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2349:x1874625005980288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 123us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782006.724285:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:3.0:1787782006.724540:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005979904 00000100:00100000:3.0:1787782006.724545:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005979904 00000100:00100000:3.0:1787782006.724617:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00100000:3.0:1787782006.724625:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2349:x1874625005979904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787782006.724657:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2349:x1874625005979904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782006.724664:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00080000:0.0:1787782006.724806:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782006.724821:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787782007.039054:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787782007.045158:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1787782007.045180:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787782007.058180:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787782007.058201:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787782007.999220:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023785088:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.999295:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782007.999378:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782007.999388:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023784960:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.999389:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023785088 00000100:00100000:0.0:1787782007.999402:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023785088 00000100:00100000:3.0:1787782007.999420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.999450:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787782007.999460:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479334b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023785088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782007.999481:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023784960 00000100:00100000:3.0:1787782007.999484:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023784960 00000100:00100000:3.0:1787782007.999511:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787782007.999512:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479334b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023785088:12345-0@lo:400:kworker.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782007.999517:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023784960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.999519:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787782007.999557:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023785088:0@lo:400:kworker.0 00000100:00100000:3.0:1787782007.999561:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44649a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3305:x1874625023784960:12345-0@lo:400:kworker.0 Request processed in 44us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782007.999566:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787782007.999592:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023785216:0@lo:400:kworker.0 00000100:00100000:3.0:1787782007.999609:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef478f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023784960:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.999615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782007.999635:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023785216 00000100:00100000:3.0:1787782007.999638:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023785216 00000100:00100000:3.0:1787782007.999668:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787782007.999671:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479336d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023785600:0@lo:400:kworker.0 00000100:00100000:3.0:1787782007.999674:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4793352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023785216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.999699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782007.999700:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4793352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625023785216:12345-0@lo:400:kworker.0 Request processed in 27us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782007.999705:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1787782007.999720:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782007.999723:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023785600 00000100:00100000:0.0:1787782007.999726:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023785600 00000100:00100000:3.0:1787782007.999728:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479337c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023785344:0@lo:400:kworker.0 00000100:00100000:3.0:1787782007.999750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782007.999756:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023785344 00000100:00100000:0.0:1787782007.999759:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023785344 00000100:00100000:3.0:1787782007.999766:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782007.999771:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479337840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023785472:0@lo:400:kworker.0 00000100:00100000:0.0:1787782007.999781:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787782007.999805:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023785600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782007.999817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782007.999844:0:8308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787782007.999851:0:8308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023785344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782007.999893:0:8308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023785344:12345-0@lo:400:kworker.0 Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782007.999899:0:8308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787782007.999916:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023785472 00000100:00100000:2.0:1787782007.999920:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023785472 00000100:00080000:3.0:1787782007.999936:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787782007.999939:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782007.999941:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782007.999948:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787782007.999954:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023785472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782007.999956:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479337c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023785344:0@lo:400:kworker.0 00000100:00100000:2.0:1787782008.000002:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023785472:12345-0@lo:400:kworker.0 Request processed in 48us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782008.000004:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479337840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023785472:0@lo:400:kworker.0 00000100:00100000:2.0:1787782008.000014:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787782008.000209:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023785728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782008.000241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782008.000273:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023785216:0@lo:400:kworker.0 00000100:00100000:3.0:1787782008.000350:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023785728 00000100:00100000:3.0:1787782008.000353:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023785728 00000100:00100000:3.0:1787782008.000385:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787782008.000392:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023785728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782008.000418:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782008.000462:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625023785600:12345-0@lo:400:kworker.0 Request processed in 674us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782008.000470:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787782008.000515:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023785728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782008.000521:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787782008.000681:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023785728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782008.005749:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479336d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023785600:0@lo:400:kworker.0 00010000:00010000:2.0:1787782008.066826:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782008.510400:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023785856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782008.510484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782008.510616:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023785856 00000100:00100000:3.0:1787782008.510625:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023785856 00000100:00100000:3.0:1787782008.510681:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787782008.510691:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479334f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023785856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782008.510728:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782008.510781:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479334f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023785856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782008.510825:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787782008.510873:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023785856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782008.883901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782008.884320:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005980672 00000100:00100000:1.0:1787782008.884331:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005980672 00000100:00100000:1.0:1787782008.884412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:1.0:1787782008.884422:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+19:12320:x1874625005980672:12345-192.168.202.56@tcp:35:umount.0 00000100:00100000:1.0:1787782008.885042:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:12320:x1874625005980672:12345-192.168.202.56@tcp:35:umount.0 Request processed in 618us (1148us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787782008.885062:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00080000:3.0:1787782008.887051:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782008.890884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782008.891259:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005980928 00000100:00100000:1.0:1787782008.891269:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005980928 00000100:00100000:1.0:1787782008.891329:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:1.0:1787782008.891339:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4793370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+20:12320:x1874625005980928:12345-192.168.202.56@tcp:35:umount.0 00000100:00100000:1.0:1787782008.891712:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4793370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:12320:x1874625005980928:12345-192.168.202.56@tcp:35:umount.0 Request processed in 372us (836us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787782008.891719:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:0.0:1787782008.899228:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782008.899327:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005981184 00000100:00100000:1.0:1787782008.899337:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005981184 00000100:00100000:1.0:1787782008.899443:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:1.0:1787782008.899454:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44ff2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+21:12320:x1874625005981184:12345-192.168.202.56@tcp:35:umount.0 00000100:00100000:1.0:1787782008.900002:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44ff2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:12320:x1874625005981184:12345-192.168.202.56@tcp:35:umount.0 Request processed in 548us (782us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787782008.900012:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:3.0:1787782008.906638:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782008.907232:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005981440 00000100:00100000:2.0:1787782008.907243:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005981440 00000100:00100000:2.0:1787782008.907301:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:2.0:1787782008.907312:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+22:12320:x1874625005981440:12345-192.168.202.56@tcp:35:umount.0 00000100:00100000:2.0:1787782008.907743:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:12320:x1874625005981440:12345-192.168.202.56@tcp:35:umount.0 Request processed in 431us (1114us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787782008.907752:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:0.0:1787782008.917450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782008.917520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782008.917548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782008.917631:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782008.917665:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005982080 00000100:00100000:0.0:1787782008.917675:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005982080 00000100:00100000:0.0:1787782008.917747:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:0.0:1787782008.917758:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479336940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+7:2348:x1874625005982080:12345-192.168.202.56@tcp:9:umount.0 00000020:00000080:0.0:1787782008.917817:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c9045457f 00000020:00010000:0.0:1787782008.917824:0:6697:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ef448b36800: total 0 00000100:00080000:0.0:1787782008.917829:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9ef448b30800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787782008.917868:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787782008.918280:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005981568 00000100:00100000:1.0:1787782008.918285:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005981568 00000100:00100000:1.0:1787782008.918325:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005981696 00000100:00100000:1.0:1787782008.918328:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005981696 00000100:00100000:1.0:1787782008.918341:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005982208 00000100:00100000:1.0:1787782008.918344:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005982208 00000100:00100000:1.0:1787782008.918357:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:1.0:1787782008.918363:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479335e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+15:2350:x1874625005981568:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782008.918375:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782008.918399:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef441481400/0x3ad9816c9045403f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d82d expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782008.918424:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782008.918485:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479335e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+14:2350:x1874625005981568:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 120us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782008.918493:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:1.0:1787782008.918510:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1787782008.918515:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4793343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+13:2350:x1874625005981696:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782008.918523:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782008.918532:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440031c00/0x3ad9816c90453fa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d7f5 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782008.918541:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782008.918559:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4793343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+12:2350:x1874625005981696:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 43us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782008.918565:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1787782008.918578:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:1.0:1787782008.918584:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+11:2349:x1874625005982208:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782008.918592:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782008.918601:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef48183f600/0x3ad9816c90454229 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8f8 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782008.918609:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782008.918637:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2349:x1874625005982208:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 53us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782008.918643:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00080000:1.0:1787782008.918684:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:1.0:1787782008.918714:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ef448b36800: total 0 00010000:00010000:1.0:1787782008.918745:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef448b36800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787782008.918827:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006572bf06/0x3ad9816c90454fb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc9b expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782008.918859:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000239709d2/0x3ad9816c9045491b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dacd expref: 5 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782008.918875:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef448b36800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787782008.918887:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782008.918889:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782008.918891:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782008.920276:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479336940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fd2e199-5730-414f-9ae9-e4e10b451cbf+2:2348:x1874625005982080:12345-192.168.202.56@tcp:9:umount.0 Request processed in 2510us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782008.920290:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:0.0:1787782008.926056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782008.926237:0:12536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005982336 00000100:00100000:3.0:1787782008.926246:0:12536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005982336 00000100:00100000:3.0:1787782008.926345:0:12536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:3.0:1787782008.926356:0:12536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479335680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fd2e199-5730-414f-9ae9-e4e10b451cbf+5:2348:x1874625005982336:12345-192.168.202.56@tcp:9:umount.0 00000020:00000080:3.0:1787782008.926386:0:12536:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90454317 00000100:00080000:3.0:1787782008.926395:0:12536:0:(import.c:65:import_set_state_nolock()) ffff9ef444e5b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787782008.926444:0:12536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787782008.926714:0:12536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479335680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fd2e199-5730-414f-9ae9-e4e10b451cbf+2:2348:x1874625005982336:12345-192.168.202.56@tcp:9:umount.0 Request processed in 359us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782008.926723:0:12536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 73 00010000:00010000:0.0:1787782008.928152:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782008.936070:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782008.939372:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782008.939439:0:9081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005983360 00000100:00100000:3.0:1787782008.939449:0:9081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005983360 00000100:00100000:3.0:1787782008.939559:0:9081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 240 00000100:00100000:3.0:1787782008.939572:0:9081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+23:2348:x1874625005983360:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:3.0:1787782008.939608:0:9081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453fb3 00000020:00010000:3.0:1787782008.939624:0:9081:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ef34317f000: total 0 00000100:00080000:3.0:1787782008.939630:0:9081:0:(import.c:65:import_set_state_nolock()) ffff9ef4809aa800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787782008.939660:0:9081:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1787782008.939723:0:8461:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ef34317f000: total 0 00010000:00010000:2.0:1787782008.939767:0:8461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef34317f000, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1787782008.939828:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787782008.939832:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782008.939839:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030e00/0x3ad9816c90454f96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc8d expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.939860:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787782008.939863:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782008.939867:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fa00/0x3ad9816c904547fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140da80 expref: 21 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.939880:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787782008.939882:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787782008.939885:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90454f65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc86 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.939916:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467200) 00010000:00010000:2.0:1787782008.939919:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782008.939923:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f000/0x3ad9816c9045497d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dae9 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.939935:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef448467a00) 00010000:00010000:2.0:1787782008.939938:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782008.939942:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c90454299 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d90d expref: 19 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.939971:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787782008.939974:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782008.939978:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031800/0x3ad9816c904548dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dab8 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.939991:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ef44a9a7a00) 00010000:00010000:2.0:1787782008.939994:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787782008.939998:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415200/0x3ad9816c90454906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dac6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.940012:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787782008.940015:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787782008.940018:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3e00/0x3ad9816c90454fa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc94 expref: 15 pid: 9081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.940028:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787782008.940031:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787782008.940040:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba2e00/0x3ad9816c904545da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d9f4 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.940053:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef44a9a7800) 00010000:00010000:2.0:1787782008.940055:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782008.940059:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030800/0x3ad9816c9045427d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d906 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.940073:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787782008.940075:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00000100:00100000:3.0:1787782008.940076:0:9081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fd2e199-5730-414f-9ae9-e4e10b451cbf+12:2348:x1874625005983360:12345-192.168.202.56@tcp:39:umount.0 Request processed in 508us (713us total) trans 4294967525 rc 0/0 00010000:00010000:2.0:1787782008.940079:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e200/0x3ad9816c90454999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140daf0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782008.940084:0:9081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 240 00010000:00010000:2.0:1787782008.940090:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ef448467e00) 00010000:00010000:2.0:1787782008.940092:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787782008.940095:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415000/0x3ad9816c90454c78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dbc2 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.940274:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ef448467d00) 00010000:00010000:2.0:1787782008.940277:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787782008.940282:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904542ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d922 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.940298:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ef44a7db800) 00010000:00010000:2.0:1787782008.940300:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782008.940303:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef450ba3000/0x3ad9816c90454e9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dc4e expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782008.940315:0:8461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef34317f000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1787782008.940333:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782008.940335:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782008.940337:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782009.086236:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782010.110230:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782010.736836:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782010.737042:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005983488 00000100:00100000:1.0:1787782010.737055:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005983488 00000100:00100000:1.0:1787782010.737134:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:1.0:1787782010.737146:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2352:x1874625005983488:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782010.737164:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782010.737187:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482044800/0x3ad9816c90454085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d842 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.737207:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782010.737394:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:2352:x1874625005983488:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 249us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782010.737404:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:1.0:1787782010.739345:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782010.739392:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782010.740051:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005983616 00000100:00100000:2.0:1787782010.740061:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005983616 00000100:00100000:2.0:1787782010.740195:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005983744 00000100:00100000:2.0:1787782010.740199:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005983744 00000100:00100000:2.0:1787782010.740236:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:2.0:1787782010.740246:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+10:2351:x1874625005983616:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782010.740272:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782010.740293:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440031000/0x3ad9816c90454222 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d8f1 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782010.740309:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782010.740367:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+9:2351:x1874625005983616:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 122us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782010.740374:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:2.0:1787782010.740392:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:2.0:1787782010.740398:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4469a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+8:2352:x1874625005983744:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782010.740409:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782010.740417:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482044c00/0x3ad9816c9045408c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d86c expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782010.740427:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782010.740444:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4469a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+7:2352:x1874625005983744:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 46us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782010.740451:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:0.0:1787782010.749277:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782010.749402:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005984000 00000100:00100000:2.0:1787782010.749425:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005984000 00000100:00100000:2.0:1787782010.749536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00100000:2.0:1787782010.749547:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4793361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+6:2348:x1874625005984000:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:2.0:1787782010.749587:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c9045409a 00000020:00010000:2.0:1787782010.749595:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ef47b2cc000: total 0 00000100:00080000:2.0:1787782010.749600:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9ef47b2cc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787782010.749623:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787782010.749818:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4793361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebbe214e-e8d4-40d1-ac9b-0939da433eb8+5:2348:x1874625005984000:12345-192.168.202.56@tcp:39:umount.0 Request processed in 274us (552us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787782010.749824:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 241 00000020:00010000:2.0:1787782010.749857:0:8461:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ef47b2cc000: total 0 00010000:00010000:2.0:1787782010.749859:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782010.749886:0:8461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef47b2cc000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787782010.749917:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef448467200) 00010000:00010000:2.0:1787782010.749921:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782010.749930:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90454fc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dca2 expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782010.749960:0:8461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef47b2cc000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787782010.749972:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782010.749974:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782010.749975:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782010.750151:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782010.770062:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782010.770221:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005984256 00000100:00100000:0.0:1787782010.770231:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005984256 00000100:00100000:0.0:1787782010.770299:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:0.0:1787782010.770309:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+7:2348:x1874625005984256:12345-192.168.202.56@tcp:251:umount.0 00000020:00000080:0.0:1787782010.770362:0:5825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453f90 00000020:00010000:0.0:1787782010.770371:0:5825:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ef4809a9000: total 0 00000100:00080000:0.0:1787782010.770376:0:5825:0:(import.c:65:import_set_state_nolock()) ffff9ef4809af800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787782010.770463:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef446498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c21e94-7afd-4aa8-8d79-a4e293aaca46+3:2348:x1874625005984256:12345-192.168.202.56@tcp:251:umount.0 Request processed in 156us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782010.770489:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 302 00000020:00010000:1.0:1787782010.770990:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ef4809a9000: total 0 00010000:00010000:1.0:1787782010.771044:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef4809a9000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787782010.771078:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef451414c00/0x3ad9816c90454046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140d834 expref: 2 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782010.771092:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef4809a9000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787782010.771101:0:5820:0:(genops.c:885:class_export_put()) final put ffff9ef4809a9000/c4c21e94-7afd-4aa8-8d79-a4e293aaca46 00010000:00010000:1.0:1787782010.771118:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782010.771120:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782010.771122:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787782010.771209:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef4809a9000/c4c21e94-7afd-4aa8-8d79-a4e293aaca46 for MGS 00000020:00000080:0.0:1787782010.771262:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef4809af800 for MGS 00010000:00010000:2.0:1787782011.141667:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787782011.141918:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:2.0:1787782011.141924:0:6719:0:(genops.c:885:class_export_put()) final put ffff9ef444e5c800/3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:3.0:1787782011.142085:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef444e5c800/3fd2e199-5730-414f-9ae9-e4e10b451cbf for lustre-OST0000 00000020:00000080:3.0:1787782011.142135:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef444e5b000 for lustre-OST0000 00010000:00010000:3.0:1787782012.159655:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787782012.160944:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:3.0:1787782012.160965:0:7652:0:(genops.c:885:class_export_put()) final put ffff9ef448b36800/3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:3.0:1787782012.160989:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef448b36800/3fd2e199-5730-414f-9ae9-e4e10b451cbf for lustre-OST0001 00000020:00000080:3.0:1787782012.161030:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef448b30800 for lustre-OST0001 00000001:00080000:2.0:1787782012.164594:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:2.0:1787782012.164615:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ebbe214e-e8d4-40d1-ac9b-0939da433eb8 00000001:00080000:2.0:1787782012.164630:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787782012.164634:0:5855:0:(genops.c:885:class_export_put()) final put ffff9ef47b2cc000/ebbe214e-e8d4-40d1-ac9b-0939da433eb8 00000001:00080000:2.0:1787782012.164690:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1787782012.164698:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000001:00080000:2.0:1787782012.164707:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787782012.164709:0:5855:0:(genops.c:885:class_export_put()) final put ffff9ef34317f000/3fd2e199-5730-414f-9ae9-e4e10b451cbf 00000020:00000080:3.0:1787782012.164782:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47b2cc000/ebbe214e-e8d4-40d1-ac9b-0939da433eb8 for lustre-MDT0000 00000020:00000080:3.0:1787782012.164861:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef47b2cc800 for lustre-MDT0000 00000020:00000080:3.0:1787782012.171501:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef34317f000/3fd2e199-5730-414f-9ae9-e4e10b451cbf for lustre-MDT0000 00000020:00000080:3.0:1787782012.171576:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef4809aa800 for lustre-MDT0000 00000020:01000004:2.0:1787782012.403077:0:12979:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787782012.434303:0:12979:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787782012.434356:0:12979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.434371:0:12979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.434378:0:12979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.434385:0:12979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.434445:0:12979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787782012.434451:0:12979:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787782012.434473:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782012.434478:0:12979:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787782012.434484:0:12979:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787782012.434515:0:12979:0:(import.c:65:import_set_state_nolock()) ffff9ef476f18800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787782012.434650:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023785984:0@lo:39:umount.0 00000100:00100000:3.0:1787782012.434718:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782012.435068:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023785984 00000100:00100000:0.0:1787782012.435075:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023785984 00000100:00100000:0.0:1787782012.435125:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787782012.435134:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874625023785984:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787782012.435161:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453d9f 00000100:00080000:0.0:1787782012.435168:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9ef450a27000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787782012.436217:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782012.436228:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782012.436240:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414e00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787782012.436245:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782012.436255:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782012.436263:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782012.436269:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787782012.436271:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787782012.436275:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787782012.436308:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782012.436332:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782012.436361:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782012.436369:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef451414e00/0x3ad9816c90454015 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c9045401c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782012.436383:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782012.436385:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782012.436387:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782012.436820:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023786112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782012.436890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782012.437216:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023786112 00000100:00100000:1.0:1787782012.437221:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023786112 00000100:00100000:1.0:1787782012.437273:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782012.437281:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9f3bcc54-cf30-454f-ba67-121e6963b1be+19:3306:x1874625023786112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782012.437292:0:8462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782012.437307:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482045400/0x3ad9816c9045401c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90454015 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782012.437320:0:8462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782012.437357:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:3306:x1874625023786112:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782012.437363:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782012.437397:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9f3bcc54-cf30-454f-ba67-121e6963b1be:3306:1874625023786112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782012.437670:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1874625023785984:12345-0@lo:39:umount.0 Request processed in 2535us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782012.437678:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787782012.437689:0:5833:0:(genops.c:885:class_export_put()) final put ffff9ef450a25000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1787782012.437778:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef476f18800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787782012.437811:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023785984:0@lo:39:umount.0 00000100:00080000:0.0:1787782012.437867:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782012.437871:0:12979:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787782012.437883:0:12979:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787782012.438837:0:12979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.438851:0:12979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.438859:0:12979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.438865:0:12979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787782012.439300:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef450a25000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787782012.439345:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef450a27000 for lustre-MDT0000 00010000:00010000:2.0:1787782012.439957:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782012.439972:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.439981:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045e00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:2.0:1787782012.439985:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.439995:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782012.440002:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782012.440008:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787782012.440011:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787782012.440040:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.440047:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787782012.440091:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023786240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787782012.440148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782012.440587:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023786240 00000100:00100000:3.0:1787782012.440595:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023786240 00000100:00100000:3.0:1787782012.440641:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787782012.440650:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+18:3303:x1874625023786240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782012.440663:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782012.440677:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef441481000/0x3ad9816c9045402a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90454023 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.440692:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782012.440739:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.440750:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782012.440752:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782012.440754:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782012.440825:0:12979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787782012.440832:0:12979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482045e00/0x3ad9816c90454023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c9045402a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440846:0:12979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440854:0:12979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440862:0:12979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440869:0:12979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440884:0:12979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782012.440891:0:12979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440897:0:12979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440902:0:12979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440908:0:12979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440937:0:12979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787782012.440944:0:12979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440950:0:12979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440956:0:12979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440962:0:12979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.440968:0:12979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787782012.440972:0:12979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787782012.440976:0:12979:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787782012.441006:0:12979:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787782012.441010:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787782012.441014:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782012.441020:0:12979:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787782012.441025:0:12979:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ef47f9f0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782012.441030:0:12979:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ef450a63800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782012.441034:0:12979:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ef450c2cd28) has exports, disconnecting them 00000020:00080000:0.0:1787782012.441038:0:12979:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ef47f9f0800), last request at 1787782007 00000020:00000080:0.0:1787782012.441044:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453f12 00000100:00080000:0.0:1787782012.441059:0:12979:0:(import.c:65:import_set_state_nolock()) ffff9ef47f9f2000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787782012.441099:0:12979:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef47f9f0800): rc 0 00000020:00000080:0.0:1787782012.441102:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef47f9f0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787782012.441118:0:12979:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ef450a63800), last request at 1787782007 00000020:00000080:0.0:1787782012.441122:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453e39 00000100:00080000:0.0:1787782012.441127:0:12979:0:(import.c:65:import_set_state_nolock()) ffff9ef481805800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787782012.441135:0:12979:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef450a63800): rc 0 00000020:00000080:0.0:1787782012.441137:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef450a63800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787782012.441143:0:12979:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbf7fc0d87ae0 00000100:00080000:0.0:1787782012.441159:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787782012.441162:0:12979:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787782012.441173:0:12979:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787782012.441233:0:12979:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787782012.441246:0:12979:0:(import.c:65:import_set_state_nolock()) ffff9ef444bc7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787782012.441259:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787782012.441262:0:12979:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787782012.441269:0:12979:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787782012.441327:0:12979:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787782012.441336:0:12979:0:(import.c:65:import_set_state_nolock()) ffff9ef444b95000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787782012.441364:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ef450c2cd28) has no exports 00010000:00010000:2.0:1787782012.441475:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787782012.441481:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.441497:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9600 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:2.0:1787782012.441502:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.441515:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782012.441522:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782012.441527:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787782012.441530:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787782012.441532:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787782012.441548:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.441554:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787782012.441603:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023786624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782012.441637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787782012.441955:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782012.441961:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.441967:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3200 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787782012.441970:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.441978:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782012.441996:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782012.442001:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787782012.442004:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787782012.442006:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787782012.442021:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.442027:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782012.442043:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.442049:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c9045424c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90454253 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.442059:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782012.442062:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.442067:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441480600 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787782012.442069:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.442075:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782012.442081:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782012.442097:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787782012.442099:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787782012.442100:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787782012.442115:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.442120:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782012.442126:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.442132:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef441480600/0x3ad9816c90453cfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90453d05 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782012.442144:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782012.442146:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782012.442148:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782012.442272:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:3303:x1874625023786240:12345-0@lo:103:ldlm_bl.0 Request processed in 1621us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782012.442281:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787782012.442300:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023786624 00000100:00100000:3.0:1787782012.442304:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023786624 00000100:00100000:3.0:1787782012.442331:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787782012.442338:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4793343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:3304:x1874625023786624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782012.442354:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782012.442366:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482045800/0x3ad9816c90453f51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90453f4a expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.442379:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782012.442412:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4793343c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3304:x1874625023786624:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782012.442418:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787782012.442445:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023786752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782012.442469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782012.442488:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782012.442504:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023786880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782012.442525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782012.442544:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023786752 00000100:00100000:3.0:1787782012.442548:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023786752 00000100:00100000:3.0:1787782012.442564:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023786880 00000100:00100000:3.0:1787782012.442566:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023786880 00000100:00100000:3.0:1787782012.442578:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787782012.442583:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+17:3305:x1874625023786752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782012.442590:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782012.442597:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90454253 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c9045424c expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.442605:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782012.442629:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+16:3305:x1874625023786752:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782012.442635:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787782012.442647:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787782012.442660:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+15:3305:x1874625023786880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782012.442668:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782012.442676:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b9400/0x3ad9816c90453d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90453cfe expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.442686:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782012.442708:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f3bcc54-cf30-454f-ba67-121e6963b1be+14:3305:x1874625023786880:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782012.442714:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787782012.442744:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479334780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023786880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782012.442752:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023786752:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1787782012.442779:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47f9f0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787782012.442846:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef450a63800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787782012.442871:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef47f9f2000 for lustre-MDT0000 00000020:00000080:3.0:1787782012.442876:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef481805800 for lustre-MDT0000 00000100:00100000:3.0:1787782012.442891:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479336580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023786368:0@lo:9:umount.0 00000100:00100000:3.0:1787782012.442918:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782012.442950:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479335e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023786496:0@lo:9:umount.0 00000100:00100000:3.0:1787782012.442970:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782012.442998:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023786368 00000100:00100000:3.0:1787782012.443002:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023786368 00000100:00100000:3.0:1787782012.443034:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023786496 00000100:00100000:3.0:1787782012.443038:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023786496 00000100:00100000:3.0:1787782012.443056:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787782012.443062:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874625023786368:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787782012.443081:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453e94 00000100:00080000:3.0:1787782012.443095:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9ef4809af000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787782012.443129:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787782012.443425:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3302:x1874625023786368:12345-0@lo:9:umount.0 Request processed in 363us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782012.443432:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787782012.443445:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787782012.443451:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874625023786496:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787782012.443462:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453f7b 00000100:00080000:3.0:1787782012.443467:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9ef34317f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787782012.443483:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787782012.443670:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3302:x1874625023786496:12345-0@lo:9:umount.0 Request processed in 218us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782012.443676:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787782012.443698:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782012.443701:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782012.443727:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef444bc7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787782012.443738:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787782012.443739:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782012.443743:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479336580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023786368:0@lo:9:umount.0 00000100:00080000:3.0:1787782012.443752:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef444b95000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787782012.443760:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787782012.443762:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782012.443764:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479335e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023786496:0@lo:9:umount.0 00000100:00100000:3.0:1787782012.443822:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9f3bcc54-cf30-454f-ba67-121e6963b1be:3304:1874625023786624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782012.443839:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782012.444045:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.444056:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90453f4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90453f51 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782012.444072:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782012.444074:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782012.444075:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782012.444158:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782012.444884:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9f3bcc54-cf30-454f-ba67-121e6963b1be:3303:1874625023786240:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787782012.452079:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ef450c2cd28) has no exports 00000020:00000080:0.0:1787782012.510708:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453d59 00000020:00000080:0.0:1787782012.510726:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef476960000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787782012.510754:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787782012.510877:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476960000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787782012.513095:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782012.513109:0:12979:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787782012.513115:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ef477bf19b8) has no exports 00000020:00000080:1.0:1787782012.513392:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453d52 00000020:00000080:1.0:1787782012.513399:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef481805000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787782012.513454:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782012.513462:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787782012.513465:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef478122800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787782012.513468:0:12979:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef478122800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787782012.513477:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787782012.513565:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef481805000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787782012.513711:0:12979:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ef44300c000 - data ffff9ef4708435e8/ffff9ef47916f800 00000020:01000000:1.0:1787782012.514073:0:12979:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ef473f97cc0 - data ffff9ef452c64bd0/ffff9ef4450a3800 00000001:00000004:1.0:1787782012.529909:0:12979:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787782012.597739:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787782012.597747:0:12979:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787782012.597760:0:12979:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782012.597763:0:12979:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787782012.599311:0:6820:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787782012.599317:0:6820:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787782012.599338:0:6820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787782012.601062:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787782012.601069:0:12979:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787782012.601748:0:12979:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782012.601753:0:12979:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787782012.605700:0:7884:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787782012.605707:0:7884:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787782012.605720:0:7884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787782012.682028:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453d21 00000020:00000080:0.0:1787782012.682053:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef476f1f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787782012.682638:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476f1f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787782012.682994:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453d36 00000020:00000080:0.0:1787782012.683001:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef476f2c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787782012.683171:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787782012.683179:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782012.683187:0:12979:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787782012.683191:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ef450c299b8) has no exports 00000004:01000000:0.0:1787782012.683357:0:12979:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787782012.683365:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453f74 00000020:00000080:0.0:1787782012.683369:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef343179000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787782012.686812:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476f2c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787782012.687090:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787782012.687099:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782012.687112:0:12979:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787782012.687117:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ef476f319b8) has no exports 00000020:00000080:0.0:1787782012.687126:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453f6d 00000020:00000080:0.0:1787782012.687134:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef444b96000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787782012.687696:0:12979:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787782012.687700:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787782012.687704:0:12979:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787782012.687709:0:12979:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782012.687711:0:12979:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787782012.687741:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782012.687748:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782012.687755:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453e7f 00000020:00000080:0.0:1787782012.687760:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef4809a9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787782012.687763:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787782012.687777:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782012.687781:0:12979:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787782012.687783:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ef478eb19b8) has no exports 00000020:00000080:0.0:1787782012.687907:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453e78 00000020:00000080:0.0:1787782012.687911:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef444bc1000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787782012.688278:0:12979:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787782012.688290:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787782012.688293:0:12979:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787782012.688296:0:12979:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782012.688298:0:12979:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787782012.688325:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782012.688330:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782012.688361:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782012.688363:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782012.688366:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef476f1b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787782012.688369:0:12979:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476f1b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787782012.688374:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782012.688949:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453d3d 00000020:00000080:0.0:1787782012.688955:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef476f2f800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787782012.688960:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787782012.688964:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782012.688968:0:12979:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787782012.688970:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ef476f33370) has no exports 00000020:00000080:0.0:1787782012.688994:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782012.688998:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787782012.689001:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453d44 00000020:00000080:0.0:1787782012.689005:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef476f2f000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787782012.689012:0:12979:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef4450df800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787782012.689016:0:12979:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef4450df800 3 00000020:01000004:0.0:1787782012.689019:0:12979:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ef4450df800 from lustre-MDT0000 00000020:00000080:0.0:1787782012.689043:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782012.689047:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787782012.689049:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef476f1b000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787782012.689051:0:12979:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476f1b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787782012.689182:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef343179000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787782012.689191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef444b96000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787782012.689201:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef444b95000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787782012.689206:0:8:0:(genops.c:885:class_export_put()) final put ffff9ef47f5b5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787782012.689208:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47f5b5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787782012.689212:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787782012.689267:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef4809a9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787782012.689273:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef444bc1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787782012.689277:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef444bc7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787782012.689281:0:8:0:(genops.c:885:class_export_put()) final put ffff9ef47b2cf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787782012.689283:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47b2cf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787782012.689287:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787782012.689352:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476f2f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787782012.689356:0:8:0:(genops.c:885:class_export_put()) final put ffff9ef476f28000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787782012.689358:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476f28000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787782012.689362:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787782012.689529:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476f2f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787782012.689615:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787782012.689646:0:12979:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787782012.689650:0:12979:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787782012.689653:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787782012.689663:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782012.689667:0:12979:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787782012.689673:0:12979:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ef444cb2000 9f3bcc54-cf30-454f-ba67-121e6963b1be 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782012.689678:0:12979:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ef450c799b8) has exports, disconnecting them 00000020:00080000:0.0:1787782012.689683:0:12979:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ef444cb2000), last request at 1787781798 00000020:00000080:0.0:1787782012.689696:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453cdb 00000020:00010000:0.0:1787782012.689700:0:12979:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ef444cb2000: total 0 00000100:00080000:0.0:1787782012.689704:0:12979:0:(import.c:65:import_set_state_nolock()) ffff9ef444cb0800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787782012.689726:0:12979:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef444cb2000): rc 0 00000020:00080000:0.0:1787782012.689731:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ef450c799b8) has no exports 00000020:00010000:3.0:1787782012.689843:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ef444cb2000: total 0 00010000:00010000:3.0:1787782012.689865:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ef444cb2000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787782012.689895:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482045200/0x3ad9816c90453fe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90453fdd expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.689921:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482044000/0x3ad9816c90453ff2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90453feb expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.689945:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef441480800/0x3ad9816c90454000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90453ff9 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.689955:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef451415a00/0x3ad9816c9045400e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90454007 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.689965:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef451415800/0x3ad9816c90454237 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90454230 expref: 5 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.689974:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef451414800/0x3ad9816c90454245 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c9045423e expref: 4 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.689986:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef441481600/0x3ad9816c90454038 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90454031 expref: 3 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.689997:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b9800/0x3ad9816c90453dec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3ad9816c90453de5 expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782012.690006:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ef444cb2000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787782012.690019:0:5820:0:(genops.c:885:class_export_put()) final put ffff9ef444cb2000/9f3bcc54-cf30-454f-ba67-121e6963b1be 00010000:00010000:3.0:1787782012.690032:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782012.690034:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782012.690036:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787782012.690041:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef444cb2000/9f3bcc54-cf30-454f-ba67-121e6963b1be for MGS 00000020:00000080:3.0:1787782012.690077:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef444cb0800 for MGS 00000100:00100000:2.0:1787782012.691046:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ef450ba6000:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1787782012.691936:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ef446480e00:5827] 2 exiting: rc = 0 00000100:00100000:3.0:1787782012.692609:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ef446481200:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1787782012.694221:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694232:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694238:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694245:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694250:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694256:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694263:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694269:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694276:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694283:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694290:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694296:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694302:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694308:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694313:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694319:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694325:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694333:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694339:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694345:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694351:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694357:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694362:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694379:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694385:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694391:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694397:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694402:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694408:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694413:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694419:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694424:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694430:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694436:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694441:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694447:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694452:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694458:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694463:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694469:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694475:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694481:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694559:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694568:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694573:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694579:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694584:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694589:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694594:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694599:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694604:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694609:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694613:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694618:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694623:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694628:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694632:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694637:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694649:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694655:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694660:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694665:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694669:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.694675:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787782012.695280:0:12979:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787782012.695285:0:12979:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787782012.696655:0:12979:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ef44300c6c0 - data ffff9ef470838ca8/ffff9ef47916d800 00000020:01000000:0.0:1787782012.696831:0:12979:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ef442d10cc0 - data ffff9ef47083fca8/ffff9ef4464e6c00 00000020:00000080:0.0:1787782012.697318:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453cc6 00000020:00000080:0.0:1787782012.697327:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef448bec000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787782012.697343:0:12979:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef4450df800 from MGS, refs=2 00000020:01000004:0.0:1787782012.697347:0:12979:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef4450df800 2 00000020:01000004:0.0:1787782012.697350:0:12979:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ef4450df800 from MGS 00000020:00000080:0.0:1787782012.697370:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782012.697376:0:12979:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787782012.697379:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef448beb800/MGS 00000020:00000080:0.0:1787782012.697382:0:12979:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef448beb800/MGS for MGS 00000020:01000000:0.0:1787782012.697388:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787782012.697438:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787782012.697442:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782012.697447:0:12979:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787782012.697453:0:12979:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ef476f19000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782012.697458:0:12979:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9ef450c78000) has exports, disconnecting them 00000020:00080000:0.0:1787782012.697462:0:12979:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ef476f19000), last request at 1787781798 00000020:00000080:0.0:1787782012.697466:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453d91 00000020:00080000:0.0:1787782012.697476:0:12979:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef476f19000): rc 0 00000020:00000080:0.0:1787782012.697480:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef476f19000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787782012.698154:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef448bec000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787782012.698164:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476f19000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787782012.698895:0:12979:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787782012.698900:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782012.698905:0:12979:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787782012.698911:0:12979:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787782012.699135:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef476f18800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787782012.699183:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782012.699189:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787782012.699194:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef476966000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787782012.699197:0:12979:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef476966000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787782012.699202:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787782012.699256:0:12979:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef4450df800 1 00000020:00000080:2.0:1787782012.699261:0:12979:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453cb8 00000020:00000080:2.0:1787782012.699266:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef448be9800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787782012.699281:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787782012.699285:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787782012.699290:0:12979:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787782012.699293:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ef450c28000) has no exports 00000020:00000080:3.0:1787782012.699369:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef448be9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787782012.713647:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782012.713661:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787782012.713666:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef4450de800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787782012.713671:0:12979:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef4450de800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787782012.713677:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787782012.713837:0:12979:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ef4450dd800 00000020:01000000:3.0:1787782012.713871:0:12979:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787782012.713874:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782012.713878:0:12979:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787782012.713882:0:12979:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ef450c7cd28) has no exports 00000100:00100000:3.0:1787782012.713954:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ef442fa0200:5834] 1 exiting: rc = 0 00000100:00100000:3.0:1787782012.714052:0:9081:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ef479132600:9081] 3 exiting: rc = 0 00000100:00100000:0.0:1787782012.716663:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ef44654ca00:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1787782012.718944:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ef454828a00:5835] 2 exiting: rc = 0 00000100:00100000:3.0:1787782012.719195:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719202:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719207:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719213:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719218:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719224:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719229:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719235:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719241:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719245:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719250:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719256:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719260:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719265:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719270:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719277:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719298:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719303:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719309:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719316:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719322:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719327:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719332:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719337:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719342:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719347:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719353:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719357:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719362:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719368:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719374:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719379:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719383:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719388:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719393:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719398:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719403:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719407:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719412:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719418:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719423:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719427:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719432:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719437:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719442:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719446:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719451:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719467:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719474:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719479:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719485:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719495:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719500:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719505:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719510:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719515:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719520:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719524:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719529:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719533:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719538:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719542:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719547:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.719553:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.722740:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ef4465c0800:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1787782012.726290:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ef443353400:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1787782012.726694:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726705:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726712:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726719:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726725:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726732:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726738:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726745:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726752:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726758:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726764:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726771:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726778:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726783:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726811:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726818:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726823:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726828:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726834:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726839:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726844:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726848:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726867:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726872:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726877:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726883:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726888:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726893:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726898:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726903:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726908:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726914:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726918:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726932:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726938:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726944:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726949:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726953:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726958:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726964:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726969:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726973:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726978:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726984:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726989:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726994:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.726999:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727003:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727009:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727013:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727018:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727022:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727027:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727031:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727036:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727040:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727045:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727056:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727061:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727066:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727071:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727076:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727081:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727085:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.727517:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ef445649600:5839] 1 exiting: rc = 0 00000100:00100000:2.0:1787782012.727681:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ef445648800:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1787782012.731143:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731154:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731160:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731166:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731171:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731177:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731183:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731189:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731195:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731220:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731228:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731234:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731240:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731246:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731251:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731257:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731262:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731269:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731275:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731281:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731287:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731308:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731316:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731322:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731328:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731341:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731347:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731365:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731371:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731377:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731383:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731389:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731395:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731414:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731420:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731425:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731431:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731437:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731442:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731448:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731454:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731460:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731465:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731471:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731477:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731495:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731502:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731508:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731513:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731519:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731524:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731530:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731536:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731541:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731548:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731554:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731560:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731579:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731586:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731592:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731597:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731603:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731615:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.731628:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.762651:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ef445648c00:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1787782012.762758:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ef445649200:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1787782012.763945:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763953:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763958:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763963:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763967:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763972:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763976:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763981:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763985:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763990:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.763995:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764000:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764004:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764009:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764014:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764018:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764023:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764028:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764042:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764047:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764051:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764057:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764061:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764067:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764071:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764076:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764081:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764085:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764090:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764095:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764099:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764105:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764110:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764116:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764122:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764127:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764131:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764136:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764141:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764146:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764152:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764158:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764163:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764168:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764174:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764179:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764184:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764190:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764196:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764201:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764207:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764212:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764217:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764230:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764235:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764239:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764245:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764250:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764255:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764260:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764264:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764269:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764275:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782012.764280:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.769299:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ef445643400:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1787782012.769692:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ef445643200:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1787782012.772687:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772698:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772704:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772710:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772716:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772721:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772727:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772733:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772742:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772748:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772752:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772756:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772761:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772764:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772770:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772777:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772782:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772805:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772812:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772817:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772823:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772828:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772833:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772837:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772841:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772845:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772848:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772852:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772855:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772859:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772862:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772865:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772881:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772887:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772892:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772897:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772902:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772908:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772914:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772920:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772936:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772943:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772947:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772952:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772956:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772959:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772963:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772967:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772970:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772974:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772977:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772980:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772984:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772987:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772990:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.772993:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773003:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773006:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773010:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773013:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773016:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773020:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773023:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773027:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773326:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ef445642400:5845] 1 exiting: rc = 0 00000100:00100000:3.0:1787782012.773398:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ef445642600:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1787782012.773427:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773438:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773442:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773446:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773450:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773454:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773458:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773462:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773465:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773469:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773472:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773476:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773479:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773483:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773487:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773492:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773497:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773501:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773506:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773510:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773515:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773519:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773524:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773530:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773535:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773540:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773546:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773550:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773555:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773558:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773561:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773564:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773568:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773571:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773575:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773579:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773588:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773591:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773595:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773599:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773602:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773606:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773610:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773613:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773617:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773620:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773624:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773627:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773630:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773634:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773637:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773640:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773644:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773646:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773649:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773652:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773656:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773658:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773661:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773664:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773667:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773671:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773674:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.773678:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782012.774958:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ef445647200:5848] 2 exiting: rc = 0 00000100:00100000:1.0:1787782012.775283:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ef44657de00:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1787782012.775440:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ef4465f8c00:5847] 1 exiting: rc = 0 00000100:00100000:3.0:1787782012.775622:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775630:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775636:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775642:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775647:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775652:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775657:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775671:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775678:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775698:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775709:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775716:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775723:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775729:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775735:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775740:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775746:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775753:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775759:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775764:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775770:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775776:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775810:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775817:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775823:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775829:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775834:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775840:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775846:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775851:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775857:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775863:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775880:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775900:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775907:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775913:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775920:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775936:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775942:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775948:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775954:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775960:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775973:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775978:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775984:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775990:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.775996:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776102:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776109:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776115:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776120:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776126:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776132:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776138:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776143:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776149:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776155:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776160:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776167:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776172:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776178:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776183:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776189:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782012.776194:0:12979:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787782012.788408:0:12979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782012.788421:0:12979:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787782012.788427:0:12979:0:(genops.c:885:class_export_put()) final put ffff9ef448bef800/MDS_uuid 00000020:00000080:3.0:1787782012.788432:0:12979:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef448bef800/MDS_uuid for MDS 00000020:01000000:3.0:1787782012.788437:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787782012.788581:0:12979:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1787782013.118827:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023787136:0@lo:400:kworker.0 00000400:00000100:2.0:1787782013.118887:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625023787136 offset 0 length 224: 4 00000100:00100000:2.0:1787782013.118979:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782013.118985:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023787008:0@lo:400:kworker.0 00000400:00000100:2.0:1787782013.119005:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625023787008 offset 0 length 224: 4 00010000:00010000:2.0:1787782013.182138:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782014.206177:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782015.229978:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787782015.549759:0:13128:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787782015.567105:0:13128:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787782015.567220:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782015.567234:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782015.567243:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782015.567251:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782015.567301:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787782015.567306:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787782015.567331:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782015.567342:0:13128:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef47695e940 x1874625023787008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782015.567364:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787782015.567369:0:13128:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787782015.567392:0:13128:0:(import.c:65:import_set_state_nolock()) ffff9ef444bc7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787782015.567453:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874625023787264:0@lo:39:umount.0 00000400:00000100:3.0:1787782015.567573:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625023787264 offset 0 length 224: 4 00000100:00100000:1.0:1787782015.567677:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625023787008:0@lo:400:kworker.0 00010000:00010000:2.0:1787782015.567718:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782015.567726:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782015.567735:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441481800 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:2.0:1787782015.567739:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782015.567748:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782015.567757:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782015.567781:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787782015.567784:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787782015.569334:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787782015.569374:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782015.569388:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782015.569422:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782015.569432:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef441481800/0x3ad9816c90453ff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3ad9816c90454000 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782015.569445:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782015.569447:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782015.569449:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782015.569589:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023787392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782015.569663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782015.570050:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023787392 00000100:00100000:0.0:1787782015.570058:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023787392 00000100:00100000:0.0:1787782015.570250:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787782015.570260:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3305:x1874625023787392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787782015.570267:0:5818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787782015 with bad export cookie 4240562827422940379 00000100:00100000:0.0:1787782015.587756:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3305:x1874625023787392:12345-0@lo:103:ldlm_bl.0 Request processed in 17476us (18073us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787782015.587835:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787782015.589424:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787782015.589432:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ef450df8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787782015.589436:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787782015.598634:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.156@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787782015.598640:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787782015.598651:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef47695d680 x1874625023787392/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787782031 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787782015.598664:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787782015.598667:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787782015.598669:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787782015.598672:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ef450df8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782015.598677:0:3305:0:(import.c:510:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 165 00000100:00080000:3.0:1787782015.598685:0:3305:0:(import.c:624:import_select_connection()) MGC192.168.202.156@tcp: import ffff9ef450df8800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1787782015.599385:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47932e1c0 x1874625023787520/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782015.599429:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9f3bcc54-cf30-454f-ba67-121e6963b1be:3305:1874625023787392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782015.599563:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9f3bcc54-cf30-454f-ba67-121e6963b1be:3302:1874625023787520:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1787782015.599627:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874625023787520 offset 0 length 520: 4 00010000:00010000:0.0:1787782016.257597:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787782016.272115:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787782016.272126:0:6719:0:(genops.c:885:class_export_put()) final put ffff9ef4809ab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787782016.272274:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef4809ab000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787782016.272328:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef4809af000 for lustre-OST0000 00010000:00010000:0.0:1787782017.279880:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787782017.311639:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787782017.311648:0:7652:0:(genops.c:885:class_export_put()) final put ffff9ef34317c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787782017.311723:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef34317c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787782017.311837:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef34317f800 for lustre-OST0001 00000100:00080000:1.0:1787782018.238267:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787782018.238279:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787782018.238374:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023787648:0@lo:400:kworker.0 00000400:00000100:2.0:1787782018.238440:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625023787648 offset 0 length 224: 4 00010000:00010000:2.0:1787782018.302275:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782019.326069:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787782020.286524:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782020.286535:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787782020.286677:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782020.286697:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023787776:0@lo:400:kworker.0 00000400:00000100:2.0:1787782020.286757:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625023787776 offset 0 length 224: 4 00010000:00010000:0.0:1787782020.352182:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782021.374577:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782022.398157:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782023.425387:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782024.446124:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782025.407454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787782025.407465:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787782025.407635:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023787904:0@lo:400:kworker.0 00000400:00000100:2.0:1787782025.407687:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625023787904 offset 0 length 224: 4 00010000:00010000:0.0:1787782025.470255:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782025.919756:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782015/real 1787782015] req@ffff9ef47932e1c0 x1874625023787520/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787782025 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782025.919832:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef47932e1c0 x1874625023787520/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787782025 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782025.919842:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782015/real 1787782015] req@ffff9ef479335a40 x1874625023787264/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782025 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782025.919853:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef479335a40 x1874625023787264/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782025 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787782025.919869:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef450df8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782025.919892:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787782025.919896:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9f3bcc54-cf30-454f-ba67-121e6963b1be:3302:1874625023787520:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1787782025.919901:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef444bc7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787782025.919913:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874625023787264:0@lo:39:umount.0 00000100:00080000:0.0:1787782025.920056:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782025.920060:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787782025.920064:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787782025.921358:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782025.921373:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782025.921380:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782025.921387:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782025.921429:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782025.921437:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782025.921444:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782025.921450:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782025.921456:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782025.921467:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787782025.921470:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787782025.921489:0:13128:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787782025.921493:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787782025.921497:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782025.921502:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787782025.921506:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ef4468199b8) has no exports 00000020:00080000:0.0:1787782025.921528:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ef4468199b8) has no exports 00010000:00010000:2.0:1787782025.921857:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782025.921871:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782025.921878:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414000 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:2.0:1787782025.921882:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782025.921891:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782025.921898:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782025.921904:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787782025.921906:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787782025.921909:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787782025.921932:0:8461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef450df8800 00010000:00010000:2.0:1787782025.921937:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782025.921943:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef451414000/0x3ad9816c90454007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c9045400e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782025.921957:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782025.921960:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782025.921965:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415e00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:2.0:1787782025.921968:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782025.921984:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782025.921990:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782025.921996:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787782025.921998:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787782025.922000:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787782025.922005:0:8461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef450df8800 00010000:00010000:2.0:1787782025.922007:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782025.922013:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef451415e00/0x3ad9816c9045423e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90454245 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782025.922021:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782025.922023:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782025.922025:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787782025.922310:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782025.922314:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787782025.922318:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ef450df8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782025.922324:0:8:0:(import.c:510:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 383 00000100:00080000:3.0:1787782025.922329:0:8:0:(import.c:589:import_select_connection()) MGC192.168.202.156@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787782025.922340:0:8:0:(import.c:624:import_select_connection()) MGC192.168.202.156@tcp: import ffff9ef450df8800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1787782025.922368:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47932da40 x1874625023788032/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787782025.922453:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782025.922870:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9f3bcc54-cf30-454f-ba67-121e6963b1be:3302:1874625023788032:0@lo:250:kworker.0 00000400:00000100:2.0:1787782025.923056:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874625023788032 offset 0 length 520: 4 00000020:01000000:0.0:1787782025.929386:0:13128:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ef44300c4e0 - data ffff9ef47fcb0bd0/ffff9ef478e8cc00 00000020:01000000:0.0:1787782025.929550:0:13128:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ef47891f8a0 - data ffff9ef4717f6000/ffff9ef446981c00 00100000:10000000:0.0:1787782025.944913:0:13128:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787782026.038113:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453e08 00000020:00000080:3.0:1787782026.038124:0:13128:0:(genops.c:885:class_export_put()) final put ffff9ef47f35f800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787782026.038148:0:13128:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef450a67000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787782026.038151:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef450a67000 2 00000020:01000004:3.0:1787782026.038154:0:13128:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ef450a67000 from lustre-OST0000 00000020:00000080:3.0:1787782026.038190:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782026.038199:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787782026.038201:0:13128:0:(genops.c:885:class_export_put()) final put ffff9ef47f35d000/lustre-OST0000_UUID 00000020:00000080:3.0:1787782026.038204:0:13128:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47f35d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787782026.038212:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787782026.038257:0:13128:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787782026.038261:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787782026.038264:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47f35f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787782026.038265:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782026.038270:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787782026.038276:0:13128:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ef47b2ca000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787782026.038281:0:13128:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9ef450c7b370) has exports, disconnecting them 00000020:00080000:3.0:1787782026.038286:0:13128:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ef47b2ca000), last request at 1787781812 00000020:00000080:3.0:1787782026.038290:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453e32 00000020:00080000:3.0:1787782026.038299:0:13128:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef47b2ca000): rc 0 00000020:00000080:3.0:1787782026.038304:0:13128:0:(genops.c:885:class_export_put()) final put ffff9ef47b2ca000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787782026.038357:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47b2ca000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787782026.050946:0:13128:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787782026.050955:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782026.050959:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787782026.050967:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787782026.051205:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782026.051213:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787782026.051221:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef450a67000 1 00000020:00000080:2.0:1787782026.051238:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453dc2 00000020:00000080:2.0:1787782026.051247:0:13128:0:(genops.c:885:class_export_put()) final put ffff9ef450a60000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787782026.051252:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787782026.051256:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787782026.051260:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787782026.051264:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ef446818000) has no exports 00000020:00000080:1.0:1787782026.051829:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef444bc7000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787782026.051837:0:8:0:(genops.c:885:class_export_put()) final put ffff9ef47b2ce800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787782026.051840:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47b2ce800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787782026.051847:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787782026.051906:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef450a60000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787782026.068136:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782026.068151:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787782026.068156:0:13128:0:(genops.c:885:class_export_put()) final put ffff9ef450a62800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787782026.068161:0:13128:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef450a62800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787782026.068180:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787782026.068309:0:13128:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ef450a63000 00000020:02000400:1.0:1787782026.068353:0:13128:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787782026.493972:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782027.521410:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782028.543116:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787782028.970005:0:13282:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787782028.986009:0:13282:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787782028.986124:0:13282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782028.986145:0:13282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782028.986152:0:13282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782028.986159:0:13282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782028.986186:0:13282:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787782028.986192:0:13282:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787782028.986218:0:13282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787782028.986233:0:13282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef47695c000 x1874625023787136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782028.986261:0:13282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef47f3e4000 x1874625023787648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787782028.986279:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782028.986287:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782028.986324:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414200 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787782028.986328:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782028.986337:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782028.986344:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782028.986350:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787782028.986352:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787782028.986355:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787782028.986372:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef450df8800 00010000:00010000:0.0:1787782028.986376:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782028.986382:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef451414200/0x3ad9816c90453fdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90453fe4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782028.986394:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782028.986396:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782028.986398:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782028.987399:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023787136:0@lo:400:kworker.0 00000100:00100000:1.0:1787782028.987481:0:13282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef47932e580 x1874625023787776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782036 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782028.987490:0:13282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef47f3e5a40 x1874625023787904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782041 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782028.987498:0:13282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787782028.987507:0:13282:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787782028.987519:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625023787648:0@lo:400:kworker.0 00000100:00100000:3.0:1787782028.987851:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023787904:0@lo:400:kworker.0 00000100:00100000:3.0:1787782028.987859:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625023787776:0@lo:400:kworker.0 00000100:00080000:1.0:1787782028.988151:0:13282:0:(import.c:65:import_set_state_nolock()) ffff9ef47f9f3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787782028.988239:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874625023788160:0@lo:39:umount.0 00000400:00000100:2.0:1787782028.988294:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625023788160 offset 0 length 224: 4 00010000:00010000:2.0:1787782029.566424:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782030.591216:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787782031.040487:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787782031.040500:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787782031.621507:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782032.638073:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782033.666701:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782034.686309:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782035.711286:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782036.157978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787782036.157989:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787782036.736073:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782037.758236:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782038.206633:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782028/real 1787782028] req@ffff9ef47f3e52c0 x1874625023788160/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782038 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782038.206668:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef47f3e52c0 x1874625023788160/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782038 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787782038.206687:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef47f9f3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787782038.206729:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874625023788160:0@lo:39:umount.0 00000100:00080000:1.0:1787782038.206759:0:13282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787782038.206763:0:13282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787782038.206768:0:13282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787782038.208918:0:13282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782038.208935:0:13282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782038.208943:0:13282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782038.208950:0:13282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782038.208970:0:13282:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782038.208977:0:13282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782038.208997:0:13282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782038.209004:0:13282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782038.209010:0:13282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782038.209027:0:13282:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787782038.209032:0:13282:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787782038.209053:0:13282:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787782038.209057:0:13282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787782038.209061:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782038.209067:0:13282:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787782038.209071:0:13282:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ef477bf0000) has no exports 00000020:00080000:1.0:1787782038.209104:0:13282:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ef477bf0000) has no exports 00010000:00010000:0.0:1787782038.209704:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782038.209713:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782038.209735:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030400 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787782038.209740:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782038.209749:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782038.209756:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782038.209762:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787782038.209764:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787782038.209767:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787782038.209782:0:8461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef450df8800 00010000:00010000:0.0:1787782038.209786:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782038.209832:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef440030400/0x3ad9816c90453feb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90453ff2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782038.209848:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782038.209852:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782038.209858:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ec00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:0.0:1787782038.209861:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782038.209867:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782038.209879:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782038.209884:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787782038.209886:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787782038.209888:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787782038.209895:0:8461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef450df8800 00010000:00010000:0.0:1787782038.209898:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782038.209904:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef48183ec00/0x3ad9816c90454230 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90454237 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782038.209916:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782038.209918:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782038.209920:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782038.213543:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787782038.223824:0:13282:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ef44300c120 - data ffff9ef452c555e8/ffff9ef47fa49400 00000020:01000000:1.0:1787782038.223966:0:13282:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ef473c7fba0 - data ffff9ef470892360/ffff9ef479174400 00100000:10000000:1.0:1787782038.240661:0:13282:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787782038.275526:0:13282:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453ee1 00000020:00000080:0.0:1787782038.275535:0:13282:0:(genops.c:885:class_export_put()) final put ffff9ef47fa57800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787782038.275557:0:13282:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef444b97000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787782038.275560:0:13282:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef444b97000 2 00000020:01000004:0.0:1787782038.275562:0:13282:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ef444b97000 from lustre-OST0001 00000020:00000080:0.0:1787782038.275586:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782038.275594:0:13282:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787782038.275596:0:13282:0:(genops.c:885:class_export_put()) final put ffff9ef47f9f0000/lustre-OST0001_UUID 00000020:00000080:0.0:1787782038.275598:0:13282:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47f9f0000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787782038.275604:0:13282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787782038.275709:0:13282:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9f3bcc54-cf30-454f-ba67-121e6963b1be->MGS 00010000:00010000:0.0:1787782038.275724:0:13282:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef441481200/0x3ad9816c90453de5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90453dec expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782038.275754:0:13282:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef441481200/0x3ad9816c90453de5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90453dec expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782038.275760:0:13282:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787782038.275763:0:13282:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787782038.275766:0:13282:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787782038.275781:0:13282:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef450df8800 00010000:00010000:0.0:1787782038.275784:0:13282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef441481200/0x3ad9816c90453de5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90453dec expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787782038.275934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47fa57800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1787782038.275992:0:13282:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3ad9816c90454038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782038.276000:0:13282:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3ad9816c90454038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782038.276006:0:13282:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787782038.276008:0:13282:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787782038.276010:0:13282:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787782038.276026:0:13282:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ef450df8800 00010000:00010000:0.0:1787782038.276030:0:13282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482045000/0x3ad9816c90454031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3ad9816c90454038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787782038.276047:0:13282:0:(import.c:65:import_set_state_nolock()) ffff9ef450df8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787782038.276052:0:13282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787782038.276054:0:13282:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787782038.276055:0:13282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787782038.276059:0:13282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787782038.276070:0:13282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ef47932da40 x1874625023788032/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787782040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787782038.276316:0:13282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787782038.276320:0:13282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1787782038.276370:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9f3bcc54-cf30-454f-ba67-121e6963b1be:3302:1874625023788032:0@lo:250:kworker.0 10000000:01000000:0.0:1787782038.276430:0:13282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787782038.276437:0:13282:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453cd4 00000020:00000080:0.0:1787782038.276442:0:13282:0:(genops.c:885:class_export_put()) final put ffff9ef448401800/9f3bcc54-cf30-454f-ba67-121e6963b1be 00000020:01000000:0.0:1787782038.276484:0:13282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.156@tcp (flags='') 00000020:00000080:0.0:1787782038.276490:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782038.276495:0:13282:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.156@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787782038.276498:0:13282:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ef450c2b370) has no exports 10000000:01000000:3.0:1787782038.276564:0:5830:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787782038.276645:0:13282:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.156@tcp: client import never connected 00000100:00080000:0.0:1787782038.276649:0:13282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787782038.276650:0:13282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787782038.276653:0:13282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787782038.276655:0:13282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787782038.276772:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef448401800/9f3bcc54-cf30-454f-ba67-121e6963b1be for MGC192.168.202.156@tcp 00000020:00000080:2.0:1787782038.276893:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef450df8800 for MGC192.168.202.156@tcp 00000020:00000080:0.0:1787782038.276958:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782038.276964:0:13282:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.156@tcp (uuid 9f3bcc54-cf30-454f-ba67-121e6963b1be) 00000020:00000080:0.0:1787782038.276967:0:13282:0:(genops.c:885:class_export_put()) final put ffff9ef450df9000/9f3bcc54-cf30-454f-ba67-121e6963b1be 00000020:00000080:0.0:1787782038.276970:0:13282:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef450df9000/9f3bcc54-cf30-454f-ba67-121e6963b1be for MGC192.168.202.156@tcp 00000020:01000000:0.0:1787782038.276975:0:13282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.156@tcp (9f3bcc54-cf30-454f-ba67-121e6963b1be) 00000020:01000000:0.0:1787782038.277249:0:13282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787782038.277253:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782038.277256:0:13282:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787782038.277261:0:13282:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ef47f9f6800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782038.277267:0:13282:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9ef477bf3370) has exports, disconnecting them 00000020:00080000:0.0:1787782038.277272:0:13282:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ef47f9f6800), last request at 1787781828 00000020:00000080:0.0:1787782038.277275:0:13282:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453f0b 00000020:00080000:0.0:1787782038.277286:0:13282:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ef47f9f6800): rc 0 00000020:00000080:0.0:1787782038.277289:0:13282:0:(genops.c:885:class_export_put()) final put ffff9ef47f9f6800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787782038.277664:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47f9f6800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787782038.284864:0:13282:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787782038.284873:0:13282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782038.284878:0:13282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787782038.284898:0:13282:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787782038.285000:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ef47f9f3000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787782038.288856:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787782038.289096:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787782038.289178:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787782038.289339:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ef444a98800:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1787782038.292906:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ef45805c800:5816] 1 exiting: rc = 0 00000100:00100000:3.0:1787782038.293052:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.293286:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ef444a99c00:5819] 2 exiting: rc = 0 00000100:00100000:3.0:1787782038.293340:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ef444a99e00:5817] 0 exiting: rc = 1 00000100:00100000:2.0:1787782038.293428:0:8462:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ef44a596400:8462] 3 exiting: rc = 0 00000100:00100000:2.0:1787782038.296920:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ef444a98c00:5818] 1 exiting: rc = 0 00000100:00100000:3.0:1787782038.297085:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297094:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297101:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297107:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297113:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297121:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297127:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297134:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297139:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297156:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297163:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297169:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297175:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297181:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297186:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297192:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297198:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297204:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297209:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297215:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297220:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297227:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297234:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297239:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297244:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297248:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297254:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297258:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297263:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297268:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297272:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297296:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297302:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297307:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297312:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297318:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297323:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297327:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297332:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297337:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297342:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297346:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297350:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297356:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297360:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297366:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297371:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297377:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297395:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297401:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297406:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297412:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297417:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297422:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297427:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297432:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297437:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297442:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297447:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297452:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297459:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297464:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297468:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.297473:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787782038.299777:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782038.299813:0:13282:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787782038.299830:0:13282:0:(genops.c:885:class_export_put()) final put ffff9ef47fa55800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787782038.299835:0:13282:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47fa55800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787782038.299841:0:13282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787782038.299881:0:13282:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef444b97000 1 00000020:00000080:3.0:1787782038.299887:0:13282:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3ad9816c90453eb0 00000020:00000080:3.0:1787782038.299893:0:13282:0:(genops.c:885:class_export_put()) final put ffff9ef47b2cb000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787782038.299908:0:13282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787782038.299913:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782038.299918:0:13282:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787782038.299922:0:13282:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9ef477bf4d28) has no exports 00000020:00000080:2.0:1787782038.300003:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47b2cb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787782038.322560:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782038.322574:0:13282:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787782038.322580:0:13282:0:(genops.c:885:class_export_put()) final put ffff9ef47f9f3800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787782038.322584:0:13282:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef47f9f3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787782038.322594:0:13282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787782038.322783:0:13282:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ef47f9f5800 00000020:01000000:2.0:1787782038.322826:0:13282:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787782038.322829:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787782038.322833:0:13282:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787782038.322837:0:13282:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ef44681b370) has no exports 00000020:00000080:2.0:1787782038.322860:0:13282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782038.322865:0:13282:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787782038.322868:0:13282:0:(genops.c:885:class_export_put()) final put ffff9ef450a66000/OSS_uuid 00000020:00000080:2.0:1787782038.322870:0:13282:0:(genops.c:844:class_export_destroy()) destroying export ffff9ef450a66000/OSS_uuid for OSS 00000020:01000000:2.0:1787782038.322873:0:13282:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787782038.322896:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787782038.323029:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ef476cf0000:6695] 1 exiting: rc = 0 00000100:00100000:2.0:1787782038.326109:0:8308:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ef480a0d400:8308] 3 exiting: rc = 0 00000100:00100000:2.0:1787782038.326219:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ef476cf0e00:6694] 0 exiting: rc = 1 00000100:00100000:3.0:1787782038.327511:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ef476cf4a00:6697] 2 exiting: rc = 0 00000100:00100000:3.0:1787782038.327596:0:12536:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9ef481a70600:12536] 4 exiting: rc = 0 00000100:00100000:2.0:1787782038.328345:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328355:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328362:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328369:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328385:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328390:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328395:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328401:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328481:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328488:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328493:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328499:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328505:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328510:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328515:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328521:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328526:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328531:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328595:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328603:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328609:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328614:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328619:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328626:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328632:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328637:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328643:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328648:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328654:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328659:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328665:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328670:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328676:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328682:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328688:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328703:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328709:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328715:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328719:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328734:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328739:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328744:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328749:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328755:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328761:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328766:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328773:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328777:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328782:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328816:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328823:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328828:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328833:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328845:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328852:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328858:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328863:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328869:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328874:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328879:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328884:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328889:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328895:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.328901:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.331741:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ef4818a9400:6699] 1 exiting: rc = 0 00000100:00100000:0.0:1787782038.331958:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ef476cf5000:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1787782038.334126:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334139:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334154:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334161:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334166:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334171:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334177:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334186:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334193:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334213:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334219:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334223:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334229:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334234:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334239:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334244:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334248:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334253:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334260:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334265:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334269:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334274:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334278:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334282:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334286:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334290:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334295:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334299:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334303:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334308:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334312:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334317:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334321:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334325:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334329:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334333:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334337:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334341:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334345:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334350:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334357:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334361:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334365:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334369:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334378:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334382:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334387:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334391:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334396:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334400:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334412:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334417:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334421:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334425:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334429:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334434:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334440:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334445:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334450:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334456:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334460:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334465:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334470:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.334476:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.335627:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ef478918a00:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1787782038.335709:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ef478919000:6702] 2 exiting: rc = 0 00000100:00100000:0.0:1787782038.339111:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ef478919a00:6700] 0 exiting: rc = 1 00000100:00100000:2.0:1787782038.339204:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339212:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339217:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339222:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339227:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339232:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339242:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339248:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339280:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339285:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339290:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339295:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339300:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339305:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339323:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339328:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339333:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339360:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339366:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339373:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339379:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339385:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339390:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339396:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339402:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339421:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339427:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339432:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339437:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339443:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339448:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339454:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339460:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339465:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339471:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339477:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339482:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339488:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339493:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339499:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339505:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339525:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339532:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339613:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339621:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339627:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339632:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339639:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339645:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339658:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339664:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339670:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339675:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339680:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339685:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339691:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339708:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339714:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339720:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339726:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339732:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339737:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339744:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.339750:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.348950:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ef478919e00:6704] 1 exiting: rc = 0 00000100:00100000:2.0:1787782038.349165:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ef478919c00:6703] 0 exiting: rc = 1 00000100:00100000:3.0:1787782038.351375:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351383:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351388:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351393:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351399:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351404:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351409:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351414:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351418:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351423:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351427:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351432:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351437:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351442:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351448:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351453:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351459:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351463:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351484:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351489:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351495:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351500:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351504:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351510:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351514:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351519:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351523:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351529:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351534:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351553:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351558:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351562:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351568:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351573:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351579:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351585:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351590:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351596:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351600:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351605:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351611:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351616:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351621:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351626:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351631:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351637:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351642:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351646:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351651:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351656:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351661:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351667:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351673:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351687:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351692:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351707:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351713:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351718:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351724:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351729:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351735:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351740:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351746:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.351752:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782038.352620:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ef47b298600:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1787782038.352854:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ef476cf2e00:6706] 1 exiting: rc = 0 00000100:00100000:3.0:1787782038.352956:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.352969:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.352978:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.352985:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.352991:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.352997:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353003:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353009:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353015:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353021:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353038:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353046:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353051:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353061:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353067:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353073:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353079:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353084:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353090:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353102:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353109:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353115:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353137:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353323:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353338:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353344:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353350:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353356:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353366:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353371:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353378:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353383:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353389:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353394:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353411:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353445:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353452:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353458:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353465:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353471:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353477:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353482:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353488:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353493:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353500:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353505:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353529:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353665:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353673:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353678:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353684:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353690:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353706:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353711:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353716:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353721:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353727:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353732:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353753:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353765:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353770:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353775:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353780:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782038.353863:0:13282:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787782038.363642:0:13282:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787782059.796178:0:13900:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787782069.171463:0:14360:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787782069.171469:0:14360:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787782069.171587:0:14360:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ef4818d0000 00000020:01000004:3.0:1787782069.171603:0:14360:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787782069.171611:0:14360:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787782069.171625:0:14360:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ef477bf3370) 00000020:00000080:3.0:1787782069.171640:0:14360:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787782069.193128:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787782069.196119:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787782069.197219:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787782069.198689:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 384: rc = 0 00100000:10000000:3.0:1787782069.198948:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 384: rc = 0 00100000:10000000:3.0:1787782069.199089:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 384: rc = 0 00100000:10000000:3.0:1787782069.199231:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 384: rc = 0 00100000:10000000:3.0:1787782069.199352:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 384: rc = 0 00100000:10000000:3.0:1787782069.199471:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 384: rc = 0 00100000:10000000:3.0:1787782069.200031:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 386: rc = 0 00100000:10000000:3.0:1787782069.202127:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 377: rc = 0 00100000:10000000:3.0:1787782069.202237:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 377: rc = 0 00100000:10000000:3.0:1787782069.204029:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 381: rc = 0 00100000:10000000:3.0:1787782069.207224:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 381: rc = 0 00100000:10000000:3.0:1787782069.208993:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 381: rc = 0 00100000:10000000:3.0:1787782069.209254:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 381: rc = 0 00100000:10000000:3.0:1787782069.211207:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 381: rc = 0 00100000:10000000:3.0:1787782069.213204:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 381: rc = 0 00100000:10000000:3.0:1787782069.215590:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 381: rc = 0 00100000:10000000:3.0:1787782069.216142:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 381: rc = 0 00100000:10000000:3.0:1787782069.216719:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 381: rc = 0 00100000:10000000:3.0:1787782069.217019:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 381: rc = 0 00100000:10000000:3.0:1787782069.217307:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 381: rc = 0 00100000:10000000:2.0:1787782069.220376:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 381: rc = 0 00100000:10000000:2.0:1787782069.222011:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 102: rc = 0 00100000:10000000:2.0:1787782069.223065:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 102: rc = 0 00100000:10000000:2.0:1787782069.223686:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 102: rc = 0 00100000:10000000:2.0:1787782069.223982:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 102: rc = 0 00100000:10000000:2.0:1787782069.224229:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 102: rc = 0 00100000:10000000:2.0:1787782069.225641:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 102: rc = 0 00100000:10000000:2.0:1787782069.226560:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 102: rc = 0 00100000:10000000:2.0:1787782069.227044:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 102: rc = 0 00100000:10000000:2.0:1787782069.227624:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 102: rc = 0 00100000:10000000:2.0:1787782069.228778:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 102: rc = 0 00100000:10000000:2.0:1787782069.229961:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 102: rc = 0 00100000:10000000:2.0:1787782069.230237:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 102: rc = 0 00100000:10000000:2.0:1787782069.230968:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 102: rc = 0 00100000:10000000:2.0:1787782069.231239:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 102: rc = 0 00100000:10000000:2.0:1787782069.231718:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 102: rc = 0 00100000:10000000:2.0:1787782069.232168:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 102: rc = 0 00100000:10000000:2.0:1787782069.232651:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 102: rc = 0 00100000:10000000:2.0:1787782069.233111:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 102: rc = 0 00100000:10000000:2.0:1787782069.233741:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 102: rc = 0 00100000:10000000:2.0:1787782069.234543:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 102: rc = 0 00100000:10000000:2.0:1787782069.234968:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 102: rc = 0 00100000:10000000:2.0:1787782069.235245:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 102: rc = 0 00100000:10000000:2.0:1787782069.235643:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 102: rc = 0 00100000:10000000:2.0:1787782069.236510:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 102: rc = 0 00100000:10000000:2.0:1787782069.236761:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 102: rc = 0 00100000:10000000:2.0:1787782069.237062:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 102: rc = 0 00100000:10000000:2.0:1787782069.237305:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 102: rc = 0 00100000:10000000:2.0:1787782069.239186:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 102: rc = 0 00100000:10000000:2.0:1787782069.239674:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 102: rc = 0 00100000:10000000:2.0:1787782069.240138:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 102: rc = 0 00100000:10000000:2.0:1787782069.240615:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 102: rc = 0 00100000:10000000:2.0:1787782069.241025:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 102: rc = 0 00100000:10000000:2.0:1787782069.241825:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 771: rc = 0 00100000:10000000:2.0:1787782069.242553:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787782069.242728:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 378: rc = 0 00100000:10000000:2.0:1787782069.243021:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787782069.243169:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 378: rc = 0 00100000:10000000:2.0:1787782069.245984:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787782069.246222:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 378: rc = 0 00100000:10000000:2.0:1787782069.250357:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787782069.250707:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1787782069.251909:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787782069.252001:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:2.0:1787782069.252233:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787782069.252305:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00000020:00000080:2.0:1787782069.252896:0:14360:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787782069.252903:0:14360:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787782069.252914:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90454fd5 00000020:01000004:2.0:1787782069.252921:0:14360:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787782069.252927:0:14360:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787782069.252932:0:14360:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef4818d0000 from MGS 00000020:01000004:2.0:1787782069.252935:0:14360:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787782069.252945:0:14360:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ef478eb4d28) 00000020:00000080:2.0:1787782069.252955:0:14360:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787782069.253021:0:14360:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef4818d0000 from MGS, refs=2 00080000:01000000:2.0:1787782069.253026:0:14360:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787782069.253031:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90454fe3 00000100:00100000:2.0:1787782069.253123:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787782069.253250:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787782069.253256:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787782069.256195:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787782069.256207:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787782069.260229:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782069.260440:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787782069.260446:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787782069.264331:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787782069.264344:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787782069.264985:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787782069.264993:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787782069.265941:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782069.265945:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782069.265947:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782069.266369:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782069.266371:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782069.266373:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782069.271995:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782069.272663:0:14360:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:1.0:1787782069.291983:0:14360:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787782069.292004:0:14360:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787782069.292007:0:14360:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787782069.298425:0:14369:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787782069.298822:0:14360:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787782069.298944:0:14360:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787782069.299470:0:14360:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787782069.302969:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787782069.303178:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787782069.303185:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787782069.321157:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787782069.321174:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787782069.322898:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787782069.322912:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787782069.324909:0:14360:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787782069.324933:0:14360:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.156@tcp' 00000020:01000004:2.0:1787782069.324935:0:14360:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787782069.324964:0:14360:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.156@tcp (typ=mgc) 00000020:00000080:2.0:1787782069.324977:0:14360:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.156@tcp (ffff9ef478eb0000) 00000020:00000080:2.0:1787782069.324992:0:14360:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787782069.325079:0:14360:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef452627800@MGC192.168.202.156@tcp: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1787782069.325240:0:14360:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.156@tcp-0 is initialized 00000040:01000000:2.0:1787782069.325246:0:14360:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787782069.325708:0:14374:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787782069.330859:0:14375:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787782069.331081:0:14360:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.156@tcp (uuid dd82860a-d07d-4a23-81c4-f74b9aa945b8) 00000020:00000080:1.0:1787782069.331105:0:14360:0:(genops.c:1385:class_connect()) connect: client dd82860a-d07d-4a23-81c4-f74b9aa945b8, cookie 0x3ad9816c90454ff1 00000100:00080000:1.0:1787782069.331118:0:14360:0:(import.c:510:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782069.331125:0:14360:0:(import.c:624:import_select_connection()) MGC192.168.202.156@tcp: import ffff9ef452627800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1787782069.331165:0:14360:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47f3e4780 x1874625023788288/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782069.331197:0:14360:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dd82860a-d07d-4a23-81c4-f74b9aa945b8->MGS 00000020:01000004:1.0:1787782069.331217:0:14360:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787782069.331240:0:14360:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787782069.331256:0:14360:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ef476f34d28) 00000020:00000080:1.0:1787782069.331270:0:14360:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787782069.333696:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3302:1874625023788288:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787782069.333813:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782069.334193:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023788288 00000100:00100000:1.0:1787782069.334201:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023788288 00000100:00100000:1.0:1787782069.334234:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782069.334241:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1874625023788288:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787782069.334268:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from dd82860a-d07d-4a23-81c4-f74b9aa945b8@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1787782069.334296:0:14370:0:(genops.c:1385:class_connect()) connect: client dd82860a-d07d-4a23-81c4-f74b9aa945b8, cookie 0x3ad9816c90454fff 00000100:00080000:1.0:1787782069.334477:0:14370:0:(import.c:65:import_set_state_nolock()) ffff9ef48089c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787782069.334543:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+5:3302:x1874625023788288:12345-0@lo:250:mount.lustre.0 Request processed in 301us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782069.334551:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787782069.334979:0:3302:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787782069.334989:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.156@tcp: connect to target with instance 0 00000100:00080000:3.0:1787782069.334996:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787782069.335001:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787782069.335004:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef452627800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787782069.335007:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787782069.335019:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787782069.335024:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3302:1874625023788288:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787782069.356325:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787782069.356715:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787782069.356722:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787782069.360655:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787782069.360670:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787782069.361294:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787782069.361301:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787782069.362404:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782069.362757:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787782069.362763:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787782069.365835:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787782069.365857:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787782069.414535:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782069.414745:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787782069.414752:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787782069.415737:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787782069.415746:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787782069.416785:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782069.417130:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787782069.417137:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787782069.417628:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787782069.417635:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787782069.418655:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782069.418885:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787782069.418891:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787782069.419425:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787782069.419432:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787782069.420084:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782069.420234:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787782069.420239:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787782069.420848:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787782069.420854:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787782069.435381:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782069.435614:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787782069.435621:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787782069.436899:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787782069.436909:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787782069.437600:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787782069.437608:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787782069.438592:0:14360:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787782069.438615:0:14360:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787782069.438621:0:14360:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787782069.438756:0:14360:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787782069.439533:0:14360:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787782069.439538:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787782069.439540:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787782069.439541:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782069.439542:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782069.439544:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782069.439545:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782069.439546:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782069.439548:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787782069.439550:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782069.439551:0:14360:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782069.439554:0:14360:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787782069.439556:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787782069.439557:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787782069.439558:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782069.439559:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782069.439560:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782069.439561:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782069.439562:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782069.439563:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787782069.439564:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782069.439565:0:14360:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782069.439996:0:14360:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787782069.440018:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788416:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787782069.440103:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.440154:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a193c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782069.440218:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023788416 00000100:00100000:0.0:1787782069.440225:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023788416 00000100:00100000:0.0:1787782069.440286:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782069.440296:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+5:14360:x1874625023788416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787782069.440339:0:14373:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787782069.440342:0:14373:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787782069.440344:0:14373:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787782069.440728:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787782069.441114:0:14373:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787782069.442069:0:14395:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787782069.442075:0:14395:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787782069.442077:0:14395:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787782069.442110:0:14395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787782069.442406:0:14373:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787782069.442425:0:14373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787782069.449138:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+5:14360:x1874625023788416:12345-0@lo:253:mount.lustre.0 Request processed in 8835us (9026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.449156:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782069.449240:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788416:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787782069.449255:0:14360:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787782069.449323:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787782069.449325:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787782069.449327:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782069.449328:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782069.449330:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782069.449331:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782069.449332:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782069.449333:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787782069.449335:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782069.449336:0:14360:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787782069.449357:0:14360:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef4818d0000 from lustre-MDT0000 10000000:01000000:3.0:1787782069.449381:0:14360:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787782069.449383:0:14360:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787782069.449388:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ef478eb0000 10000000:01000000:3.0:1787782069.449392:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787782069.449399:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ef478eb0000 from 1 10000000:01000000:3.0:1787782069.449403:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787782069.449454:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.449465:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.449476:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782069.449554:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782069.449592:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.449669:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782069.449712:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023788544 00000100:00100000:1.0:1787782069.449718:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023788544 00000100:00100000:1.0:1787782069.449812:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782069.449822:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+5:14360:x1874625023788544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782069.449840:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782069.449854:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef48183f200/0x3ad9816c9045500d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455006 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.449876:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183f200/0x3ad9816c9045500d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455006 expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.449885:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef48183f200/0x3ad9816c9045500d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455006 expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.449893:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f200, rc 0) 00000100:00100000:1.0:1787782069.449932:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+6:14360:x1874625023788544:12345-0@lo:101:mount.lustre.0 Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782069.449939:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782069.449999:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782069.450014:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.450023:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782069.450062:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782069.450087:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.450203:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.450275:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023788672 00000100:00100000:2.0:1787782069.450280:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023788672 00000100:00100000:2.0:1787782069.450300:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782069.450306:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+6:14360:x1874625023788672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782069.450555:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+6:14360:x1874625023788672:12345-0@lo:501:mount.lustre.0 Request processed in 248us (466us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787782069.450571:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782069.450734:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788672:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787782069.450755:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787782069.450776:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.450784:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782069.450824:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef4818d0000 10000000:01000000:3.0:1787782069.450843:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787782069.450848:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ef4818d0000 10000000:01000000:3.0:1787782069.450850:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787782069.450853:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ef4818d0000 from 1 10000000:01000000:3.0:1787782069.450856:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787782069.450873:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3a00/0x3ad9816c90455014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.450881:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3a00/0x3ad9816c90455014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.450897:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3a00/0x3ad9816c90455014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782069.450912:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782069.450938:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.450949:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.451046:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023788800 00000100:00100000:2.0:1787782069.451050:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023788800 00000100:00100000:2.0:1787782069.451068:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787782069.451074:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+6:14360:x1874625023788800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782069.451082:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782069.451093:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8800/0x3ad9816c9045501b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455014 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.451106:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8800/0x3ad9816c9045501b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455014 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.451114:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8800/0x3ad9816c9045501b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455014 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.451120:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8800, rc 0) 00000100:00100000:2.0:1787782069.451156:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+7:14360:x1874625023788800:12345-0@lo:101:mount.lustre.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.451162:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782069.451228:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782069.451238:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3a00/0x3ad9816c90455014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045501b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.451245:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3a00/0x3ad9816c90455014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045501b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782069.451265:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787782069.451276:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3a00/0x3ad9816c90455014 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045501b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.451282:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3a00/0x3ad9816c90455014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045501b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782069.451287:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787782069.451290:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787782069.451294:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ef4818d0000 10000000:01000000:3.0:1787782069.451296:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787782069.451299:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787782069.451301:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787782069.451314:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3800/0x3ad9816c90455022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.451327:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3800/0x3ad9816c90455022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.451335:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3800/0x3ad9816c90455022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782069.451346:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782069.451372:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.451390:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.451507:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023788928 00000100:00100000:2.0:1787782069.451511:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023788928 00000100:00100000:2.0:1787782069.451528:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787782069.451534:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+7:14360:x1874625023788928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782069.451541:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782069.451548:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b9c00/0x3ad9816c90455029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455022 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.451562:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b9c00/0x3ad9816c90455029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455022 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.451578:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b9c00/0x3ad9816c90455029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455022 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.451585:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9c00, rc 0) 00000100:00100000:2.0:1787782069.451622:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+8:14360:x1874625023788928:12345-0@lo:101:mount.lustre.0 Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.451628:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787782069.451742:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023788928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782069.451753:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3800/0x3ad9816c90455022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455029 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.451760:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3800/0x3ad9816c90455022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90455029 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782069.451823:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023789056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782069.451849:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.451864:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.451923:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023789056 00000100:00100000:2.0:1787782069.451927:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023789056 00000100:00100000:2.0:1787782069.451943:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787782069.451948:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+8:14360:x1874625023789056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782069.452397:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+9:14360:x1874625023789056:12345-0@lo:501:mount.lustre.0 Request processed in 447us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.452404:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782069.452477:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023789056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782069.452505:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023789184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782069.452544:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.452570:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.452616:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023789184 00000100:00100000:2.0:1787782069.452620:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023789184 00000100:00100000:2.0:1787782069.452637:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782069.452643:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+9:14360:x1874625023789184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782069.457370:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+9:14360:x1874625023789184:12345-0@lo:503:mount.lustre.0 Request processed in 4718us (4817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.457383:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787782069.457586:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023789184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782069.458141:0:14396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14396:1874625023789312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782069.458194:0:14396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.458234:0:14396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19300 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.458285:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023789312 00000100:00100000:2.0:1787782069.458291:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023789312 00000100:00100000:2.0:1787782069.458320:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782069.458327:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+9:14396:x1874625023789312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782069.458593:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+9:14396:x1874625023789312:12345-0@lo:502:llog_process_th.0 Request processed in 265us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.458607:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787782069.458689:0:14396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14396:1874625023789312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782069.458713:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782069.458723:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782069.458726:0:14396:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787782069.458732:0:14396:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787782069.458736:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782069.458751:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ef477bf4d28) 00000020:00000080:3.0:1787782069.458769:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787782069.458774:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787782069.458870:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787782069.458877:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90455037 00000020:00000080:3.0:1787782069.459085:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787782069.459090:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782069.459093:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782069.459095:0:14396:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787782069.459097:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782069.459101:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782069.459102:0:14396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787782069.459106:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782069.459115:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ef477bf0000) 00000020:00000080:3.0:1787782069.459124:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787782069.459128:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787782069.459130:0:14396:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787782069.459133:0:14396:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787782069.459139:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787782069.459180:0:14396:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef4818d0000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787782069.459192:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ef477bf19b8) 00000020:00000080:3.0:1787782069.459200:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787782069.459244:0:14396:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787782069.459255:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c9045504c 00000020:00000080:3.0:1787782069.459362:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787782069.459368:0:14396:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787782069.459372:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3ad9816c90455053 00080000:01000000:3.0:1787782069.459378:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787782069.459381:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c9045505a 00010000:00010000:1.0:1787782069.574344:0:14396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787782069.575726:0:14396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787782069.576783:0:14396:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787782069.579248:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ef476f30000) 00000020:00000080:1.0:1787782069.579267:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787782069.579346:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787782069.579355:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90455068 00000020:00000080:1.0:1787782069.593915:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787782069.605681:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3ad9816c9045506f 00000020:00000080:1.0:1787782069.606055:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787782069.606067:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782069.606074:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.606076:0:14396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787782069.606080:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787782069.606082:0:14396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787782069.606089:0:14396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782069.606091:0:14396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782069.606093:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787782069.606096:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.606098:0:14396:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787782069.606101:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782069.606107:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.606108:0:14396:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787782069.606113:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787782069.606146:0:14396:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787782069.606159:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782069.606162:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.606163:0:14396:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787782069.606166:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787782069.606170:0:14396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787782069.606173:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.606174:0:14396:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787782069.606177:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787782069.606183:0:14396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:1.0:1787782069.606212:0:14396:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787782069.606215:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787782069.606231:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ef476f33370) 00000020:00000080:1.0:1787782069.606245:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787782069.606250:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787782069.606299:0:14396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787782069.606305:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787782069.606310:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c9045507d 00010000:00080000:1.0:1787782069.606339:0:14396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef478b0a800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1787782069.606599:0:14396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787782069.607169:0:14396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787782069.607211:0:14396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787782069.611652:0:14396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782069.611749:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787782069.612844:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787782069.615296:0:14400:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787782069.615302:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787782069.616898:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787782069.616911:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787782069.616945:0:14396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787782069.616962:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c90455084 00000100:00080000:1.0:1787782069.616973:0:14396:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782069.616979:0:14396:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ef478b0a800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1787782069.617016:0:14396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47f3e4b40 x1874625023789440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782069.617078:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023789440:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787782069.617134:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874625023789440 offset 0 length 520: 4 00000100:00080000:1.0:1787782069.617197:0:14396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787782069.617254:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782069.617258:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.617260:0:14396:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787782069.617263:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787782069.617266:0:14396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787782069.617267:0:14396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782069.617269:0:14396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782069.617270:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787782069.617272:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.617274:0:14396:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787782069.617276:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787782069.617280:0:14396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787782069.617283:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.617284:0:14396:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787782069.617287:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787782069.617290:0:14396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:1.0:1787782069.617312:0:14396:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787782069.617314:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787782069.617326:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ef476f319b8) 00000020:00000080:1.0:1787782069.617337:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787782069.617349:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787782069.617403:0:14396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787782069.617411:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787782069.617427:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3ad9816c90455092 00010000:00080000:1.0:1787782069.617468:0:14396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef47f5b1000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1787782069.617682:0:14396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787782069.617912:0:14396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787782069.617938:0:14396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787782069.618670:0:14396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782069.618737:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787782069.618867:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787782069.631532:0:14402:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787782069.631540:0:14402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787782069.636106:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782069.636122:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787782069.636159:0:14396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787782069.636179:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c90455099 00000100:00080000:2.0:1787782069.636190:0:14396:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782069.636196:0:14396:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef47f5b1000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1787782069.636232:0:14396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47695da40 x1874625023789568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782069.636257:0:14396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787782069.636308:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782069.636313:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782069.636315:0:14396:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787782069.636318:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782069.636322:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782069.636323:0:14396:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787782069.636325:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787782069.636327:0:14396:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787782069.636329:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782069.636331:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782069.636332:0:14396:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787782069.636334:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782069.636336:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782069.636337:0:14396:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787782069.636340:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787782069.636370:0:14396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14396:1874625023789696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782069.636562:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023789568:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787782069.638077:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874625023789568 offset 0 length 520: 4 00000100:00100000:2.0:1787782069.638185:0:14396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782069.638254:0:14396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44a5ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782069.641719:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023789696 00000100:00100000:0.0:1787782069.641753:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023789696 00000100:00100000:0.0:1787782069.641836:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782069.641845:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+9:14396:x1874625023789696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782069.642132:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+9:14396:x1874625023789696:12345-0@lo:502:llog_process_th.0 Request processed in 288us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782069.642141:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787782069.642354:0:14396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14396:1874625023789696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787782069.642389:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782069.642396:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782069.642397:0:14396:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787782069.642403:0:14396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787782069.642637:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787782069.642656:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787782069.642676:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3800/0x3ad9816c90455022 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455029 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.642686:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3800/0x3ad9816c90455022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455029 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782069.642694:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef4818d0000 from 1 10000000:01000000:3.0:1787782069.642697:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787782069.642728:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.642737:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.642746:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782069.642767:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023789824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782069.642838:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.642864:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782069.643054:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023789824 00000100:00100000:0.0:1787782069.643059:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023789824 00000100:00100000:0.0:1787782069.643095:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782069.643102:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+9:14360:x1874625023789824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782069.643114:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782069.643130:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c904550a0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782069.643155:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c904550a0 expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782069.643166:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904550a0 expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782069.643174:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031800, rc 0) 00000100:00100000:0.0:1787782069.643215:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+10:14360:x1874625023789824:12345-0@lo:101:mount.lustre.0 Request processed in 113us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782069.643222:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787782069.643363:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023789824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782069.643377:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.643384:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782069.648190:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023789952:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787782069.648282:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782069.648324:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446998d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782069.648408:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023789952 00000100:00100000:0.0:1787782069.648426:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023789952 00000100:00100000:0.0:1787782069.648482:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782069.648491:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+10:14360:x1874625023789952:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787782069.648524:0:14372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787782069.648531:0:14372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787782069.648623:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+10:14360:x1874625023789952:12345-0@lo:256:mount.lustre.0 Request processed in 132us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782069.648631:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787782069.648926:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023789952:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787782069.649511:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787782069.649537:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.649549:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782069.649557:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef4818d0000 from 1 10000000:01000000:3.0:1787782069.649560:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782069.649592:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.649601:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.649610:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782069.649626:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782069.649711:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.649736:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.649956:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023790080 00000100:00100000:2.0:1787782069.649962:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023790080 00000100:00100000:2.0:1787782069.649995:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787782069.650002:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+10:14360:x1874625023790080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782069.650013:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782069.650027:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c904550ae expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.650048:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c904550ae expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.650059:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904550ae expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.650070:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8600, rc 0) 00000100:00100000:2.0:1787782069.650104:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14360:x1874625023790080:12345-0@lo:101:mount.lustre.0 Request processed in 103us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.650110:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787782069.650585:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782069.650602:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782069.650610:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782069.650660:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782069.650687:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.650714:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.650832:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023790208 00000100:00100000:2.0:1787782069.650837:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023790208 00000100:00100000:2.0:1787782069.650859:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787782069.650865:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14360:x1874625023790208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782069.651306:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14360:x1874625023790208:12345-0@lo:501:mount.lustre.0 Request processed in 439us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.651314:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787782069.652435:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782069.652558:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782069.652617:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.652697:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782069.654266:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023790336 00000100:00100000:0.0:1787782069.654274:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023790336 00000100:00100000:0.0:1787782069.654359:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782069.654367:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14360:x1874625023790336:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782069.654924:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14360:x1874625023790336:12345-0@lo:503:mount.lustre.0 Request processed in 556us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782069.654937:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782069.655016:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782069.655298:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14404:1874625023790464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782069.655345:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782069.655690:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161180 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.668560:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023790464 00000100:00100000:2.0:1787782069.668576:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023790464 00000100:00100000:2.0:1787782069.668641:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787782069.668651:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14404:x1874625023790464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782069.669012:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14404:x1874625023790464:12345-0@lo:502:llog_process_th.0 Request processed in 361us (13664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.669020:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782069.669262:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14404:1874625023790464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787782069.669299:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782069.669309:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.669312:0:14404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787782069.669318:0:14404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef4818d0000 00000020:00000080:1.0:1787782069.669321:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782069.669329:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782069.669332:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.669333:0:14404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787782069.669335:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782069.669338:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.669339:0:14404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787782069.669342:0:14404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef4818d0000 00000020:00000080:1.0:1787782069.669345:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782069.669403:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782069.669406:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.669407:0:14404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787782069.669426:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782069.669429:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.669430:0:14404:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787782069.669433:0:14404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef4818d0000 00000020:00000080:1.0:1787782069.669436:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787782069.669494:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14404:1874625023790592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782069.669538:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782069.669566:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023790592 00000100:00100000:1.0:1787782069.669570:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023790592 00000100:00100000:1.0:1787782069.669590:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787782069.669596:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14404:x1874625023790592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782069.669728:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14404:x1874625023790592:12345-0@lo:502:llog_process_th.0 Request processed in 132us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782069.669735:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787782069.669775:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161180 going to sleep for 11 seconds 00000100:00100000:1.0:1787782069.669822:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14404:1874625023790592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787782069.669841:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782069.669845:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782069.669846:0:14404:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787782069.669849:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787782069.669911:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787782069.669929:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787782069.669945:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.669955:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782069.669996:0:14360:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787782069.670004:0:14360:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef4818d0000 10000000:01000000:1.0:1787782069.670006:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef4818d0000 10000000:01000000:1.0:1787782069.670010:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787782069.670016:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef4818d0000 from 1 10000000:01000000:1.0:1787782069.670019:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787782069.670042:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183e800/0x3ad9816c904550bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.670051:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef48183e800/0x3ad9816c904550bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.670059:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef48183e800/0x3ad9816c904550bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782069.670072:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782069.670099:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782069.670113:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782069.670133:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023790720 00000100:00100000:1.0:1787782069.670137:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023790720 00000100:00100000:1.0:1787782069.670154:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787782069.670159:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14360:x1874625023790720:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782069.670168:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782069.670179:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef48183e600/0x3ad9816c904550c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c904550bc expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.670202:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183e600/0x3ad9816c904550c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c904550bc expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.670212:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef48183e600/0x3ad9816c904550c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904550bc expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.670234:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e600, rc 0) 00000100:00100000:1.0:1787782069.670263:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14360:x1874625023790720:12345-0@lo:101:mount.lustre.0 Request processed in 103us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782069.670269:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787782069.670302:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782069.670314:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef48183e800/0x3ad9816c904550bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550c3 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.670321:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef48183e800/0x3ad9816c904550bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c904550c3 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782069.670359:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782069.670382:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782069.670395:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782069.670407:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023790848 00000100:00100000:1.0:1787782069.670410:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023790848 00000100:00100000:1.0:1787782069.670438:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787782069.670443:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14360:x1874625023790848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782069.670648:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14360:x1874625023790848:12345-0@lo:501:mount.lustre.0 Request processed in 204us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782069.670656:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787782069.670685:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782069.670711:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782069.670743:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782069.670764:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782069.670777:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023790976 00000100:00100000:1.0:1787782069.670780:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023790976 00000100:00100000:1.0:1787782069.670815:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787782069.670822:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14360:x1874625023790976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782069.670944:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14360:x1874625023790976:12345-0@lo:503:mount.lustre.0 Request processed in 123us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782069.670950:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787782069.670986:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023790976:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782069.682092:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14405:1874625023791104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782069.682178:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.682227:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a19b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782069.682336:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023791104 00000100:00100000:0.0:1787782069.682343:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023791104 00000100:00100000:0.0:1787782069.682392:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787782069.682401:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14405:x1874625023791104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782069.682742:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14405:x1874625023791104:12345-0@lo:502:llog_process_th.0 Request processed in 341us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782069.682750:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787782069.685010:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14405:1874625023791104:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787782069.685090:0:14405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787782069.685121:0:14405:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ef481fc0000) 00000020:00000080:3.0:1787782069.685152:0:14405:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787782069.685241:0:14405:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef4818d0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787782069.685245:0:14405:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef4818d0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787782069.685248:0:14405:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef4818d0000 4 00010000:00080000:3.0:1787782069.685278:0:14405:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef4805bc000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:3.0:1787782069.692346:0:14405:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787782069.695706:0:14405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787782069.695747:0:14405:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787782069.695762:0:14405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3ad9816c904550d1 00000100:00080000:3.0:1787782069.695772:0:14405:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787782069.695778:0:14405:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ef4805bc000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1787782069.697988:0:14405:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47932c3c0 x1874625023791232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782069.698036:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023791232:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787782069.698108:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.698190:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023791232 00000100:00100000:3.0:1787782069.698197:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023791232 00000100:00100000:3.0:1787782069.698238:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787782069.698246:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874625023791232:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787782069.698297:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874625023791232:12345-0@lo:38:llog_process_th.0 Request processed in 50us (189us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787782069.698303:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787782069.698334:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787782069.698341:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef4805bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787782069.698356:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787782069.698359:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023791232:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787782069.698387:0:14405:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787782069.705102:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14405:1874625023791360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782069.705188:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782069.705230:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023791360 00000100:00100000:3.0:1787782069.705236:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023791360 00000100:00100000:3.0:1787782069.705277:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787782069.705285:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14405:x1874625023791360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782069.705549:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14405:x1874625023791360:12345-0@lo:502:llog_process_th.0 Request processed in 264us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782069.705557:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787782069.705608:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef342a190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782069.705630:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14405:1874625023791360:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787782069.705656:0:14405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787782069.706274:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787782069.706295:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787782069.706311:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183e800/0x3ad9816c904550bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550c3 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.706321:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef48183e800/0x3ad9816c904550bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550c3 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787782069.706368:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787782069.706370:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787782069.706371:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782069.706373:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782069.706374:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782069.706375:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782069.706377:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787782069.706378:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787782069.706380:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782069.706381:0:14360:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787782069.706384:0:14360:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787782069.706386:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787782069.706387:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787782069.706388:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782069.706389:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782069.706394:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782069.706395:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782069.706396:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787782069.706397:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787782069.706397:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782069.706398:0:14360:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787782069.706426:0:14360:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787782069.706439:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023791488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787782069.706484:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782069.706503:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445161180 going to sleep for 11 seconds 00000100:00100000:0.0:1787782069.706719:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023791488 00000100:00100000:0.0:1787782069.706725:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023791488 00000100:00100000:0.0:1787782069.706769:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787782069.706777:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14360:x1874625023791488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787782069.706821:0:14373:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787782069.706835:0:14373:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787782069.771218:0:14373:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787782069.771237:0:14373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787782069.771251:0:14394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787782069.771262:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787782069.771294:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.771318:0:14394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904550a0 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.771328:0:14394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.771384:0:14394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c904550a0 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.771404:0:14394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c904550a0 expref: 12 pid: 14373 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782069.771451:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874625023791616:0@lo:104: 00000100:00100000:2.0:1787782069.771537:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782069.771619:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fab780 going to sleep for 11 seconds 00000100:00100000:2.0:1787782069.771680:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023791616 00000100:00100000:2.0:1787782069.771689:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023791616 00000100:00100000:2.0:1787782069.771753:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782069.771765:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:14394:x1874625023791616:12345-0@lo:104: 00010000:00010000:2.0:1787782069.771781:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.771900:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787782069.771911:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:14394:x1874625023791616:12345-0@lo:104: Request processed in 146us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.771920:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782069.771991:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874625023791616:0@lo:104: 00010000:00010000:1.0:1787782069.772071:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782069.772083:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.772094:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3200 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787782069.772099:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.772109:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782069.772117:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782069.772122:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787782069.772171:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.772177:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782069.772206:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.772231:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3200/0x3ad9816c904550a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904550a7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.772248:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782069.772250:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782069.772252:0:14394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782069.772262:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782069.772319:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787782069.772333:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3306:1874625023791744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782069.772376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782069.772552:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023791744 00000100:00100000:2.0:1787782069.772557:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023791744 00010000:00010000:2.0:1787782069.772587:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904550a0 expref: 13 pid: 14373 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782069.772613:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782069.772628:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+13:3306:x1874625023791744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782069.772643:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782069.772650:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904550a0 expref: 13 pid: 14373 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772661:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c904550a0 expref: 13 pid: 14373 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772679:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440031800/0x3ad9816c904550a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c904550a0 expref: 13 pid: 14373 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772695:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772705:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787782069.772720:0:14363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001459333s 00010000:00010000:2.0:1787782069.772726:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772734:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772742:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772749:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772755:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787782069.772768:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772776:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772833:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782069.772846:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782069.772893:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:3306:x1874625023791744:12345-0@lo:103:ldlm_bl.0 Request processed in 265us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782069.772902:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782069.773170:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3306:1874625023791744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782069.773394:0:14394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782069.773408:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782069.773434:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8400/0x3ad9816c904550d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782069.785589:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14360:x1874625023791488:12345-0@lo:253:mount.lustre.0 Request processed in 78804us (79095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782069.785605:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787782069.785693:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14360:1874625023791488:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787782069.785709:0:14360:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787782069.785713:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782069.785715:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787782069.785716:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782069.785718:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782069.785719:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782069.785720:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782069.785721:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787782069.785723:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787782069.785724:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782069.785726:0:14360:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787782069.785742:0:14360:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787782069.797188:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782069.797343:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782069.797923:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782069.798089:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782069.798596:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782069.798756:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782069.800730:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782069.801602:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782069.802083:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782069.802401:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782069.802751:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782069.803103:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787782069.865051:0:14360:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787782069.865696:0:14360:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787782069.868891:0:14417:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787782069.869005:0:14417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1787782069.873967:0:14416:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787782069.873976:0:14416:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787782069.875009:0:14360:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787782069.875132:0:14360:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782069.876303:0:14417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787782069.876368:0:14417:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787782069.876371:0:14417:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1787782069.877727:0:14360:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787782069.877744:0:14360:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787782069.878097:0:14360:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782069.881309:0:14360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787782069.881946:0:14360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787782069.881981:0:14360:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787782069.882482:0:14360:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1787782069.884104:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787782069.897360:0:14360:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787782069.996819:0:14360:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787782069.996863:0:14360:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf7fc1c63988 00100000:10000000:1.0:1787782069.996871:0:14360:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787782069.998153:0:14360:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787782069.998169:0:14360:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787782069.998183:0:14360:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787782069.998200:0:14360:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787782070.343002:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787782070.783098:0:14413:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787782070.783115:0:14413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787782070.783883:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787782070.783894:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1787782070.981071:0:14375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787782070.981080:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef4818d0000 from 6 10000000:01000000:1.0:1787782070.981085:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787782070.981130:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782070.981142:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782070.981154:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782070.981180:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023791872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782070.981250:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782070.981307:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f5bdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782070.981363:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023791872 00000100:00100000:0.0:1787782070.981371:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023791872 00000100:00100000:0.0:1787782070.981434:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787782070.981441:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14375:x1874625023791872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782070.981453:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782070.981485:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c904550df expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782070.981509:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c904550df expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782070.981521:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904550df expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782070.981531:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030a00, rc 0) 00000100:00100000:0.0:1787782070.981566:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14375:x1874625023791872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782070.981571:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787782070.981607:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023791872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782070.981622:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782070.981643:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782070.981687:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4793361c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023792000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787782070.981708:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782070.981719:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fab480 going to sleep for 11 seconds 00000100:00100000:0.0:1787782070.981729:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023792000 00000100:00100000:0.0:1787782070.981731:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023792000 00000100:00100000:0.0:1787782070.981746:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787782070.981749:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a58b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14375:x1874625023792000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787782070.981761:0:14373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787782070.981775:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787782070.981777:0:14373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787782070.981856:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a58b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14375:x1874625023792000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782070.981861:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787782070.981882:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4793361c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023792000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787782070.981923:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787782070.981929:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782070.981937:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782071.359781:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787782071.806045:0:14413:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787782071.806055:0:14413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787782071.806687:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787782071.806762:0:14413:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787782071.806839:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1787782072.382929:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782073.406010:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787782074.341141:0:14659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787782074.436094:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782075.070377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782075.070384:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782075.070387:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782075.070390:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782075.070392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787782075.070395:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782075.070399:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ef4805bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782075.070412:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ef4805bc000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1787782075.070436:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef479335e00 x1874625023792256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782075.070461:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782075.070474:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4793361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023792128:0@lo:400:kworker.0 00000100:00100000:0.0:1787782075.070545:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782075.070605:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023792128 00000100:00100000:0.0:1787782075.070612:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023792128 00000100:00100000:0.0:1787782075.070658:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787782075.070668:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:3305:x1874625023792128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782075.070722:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:3305:x1874625023792128:12345-0@lo:400:kworker.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782075.070730:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787782075.070779:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4793361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023792128:0@lo:400:kworker.0 00000100:00100000:3.0:1787782075.071322:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479335e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023792256:0@lo:38:kworker.0 00000100:00100000:3.0:1787782075.071359:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782075.071409:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023792256 00000100:00100000:3.0:1787782075.071413:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023792256 00000100:00100000:3.0:1787782075.071433:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782075.071438:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874625023792256:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787782075.071462:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:3.0:1787782075.071510:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3ad9816c904550ed 00000004:00100000:3.0:1787782075.071527:0:14379:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787782075.071655:0:14379:0:(import.c:65:import_set_state_nolock()) ffff9ef47f9f5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782075.071699:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874625023792256:12345-0@lo:38:kworker.0 Request processed in 259us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782075.071706:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787782075.071743:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef479335e00 x1874625023792256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787782075.071755:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787782075.071763:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787782075.071768:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787782075.071770:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef4805bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787782075.071805:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479335e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874625023792256:0@lo:38:kworker.0 00010000:00010000:2.0:1787782075.457564:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782076.478080:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787782077.105713:0:14811:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd04354870 20000000:00000080:3.0:1787782077.105731:0:14811:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef477d7c800 uarg=0000000000000000 20000000:01000000:3.0:1787782077.105767:0:14811:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787782077.105774:0:14811:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787782077.105780:0:14811:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787782077.106720:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787782077.107287:0:14811:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787782077.116447:0:14811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787782077.116485:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782077.116505:0:14811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904550ae expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782077.116514:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782077.116559:0:14811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c904550ae expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782077.116576:0:14811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c904550ae expref: 11 pid: 14370 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782077.116593:0:14811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14811:1874625023792384:0@lo:104: 00000100:00100000:3.0:1787782077.116657:0:14811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782077.116761:0:14811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4467503c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782077.117547:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023792384 00000100:00100000:2.0:1787782077.117554:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023792384 00000100:00100000:3.0:1787782077.117683:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782077.117692:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:14811:x1874625023792384:12345-0@lo:104: 00010000:00010000:3.0:1787782077.117707:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782077.117909:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787782077.117915:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:14811:x1874625023792384:12345-0@lo:104: Request processed in 224us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782077.117922:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787782077.117925:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782077.117932:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782077.117956:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3000 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787782077.117960:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782077.117968:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782077.117975:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782077.117987:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787782077.118007:0:14811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14811:1874625023792384:0@lo:104: 00010000:00010000:1.0:1787782077.118025:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782077.118031:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782077.118032:0:14811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782077.118054:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782077.118062:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef450ba3000/0x3ad9816c904550ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904550b5 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782077.118077:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782077.118079:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782077.118080:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782077.118127:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3303:1874625023792512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782077.118159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782077.118270:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023792512 00000100:00100000:2.0:1787782077.118274:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023792512 00010000:00010000:2.0:1787782077.118295:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904550ae expref: 12 pid: 14370 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782077.118323:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782077.118330:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:3303:x1874625023792512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782077.118340:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782077.118356:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904550ae expref: 12 pid: 14370 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118366:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c904550ae expref: 12 pid: 14370 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118381:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8600/0x3ad9816c904550b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c904550ae expref: 12 pid: 14370 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118392:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118399:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118412:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118418:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118435:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118441:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118446:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787782077.118451:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118458:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118645:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782077.118654:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782077.118684:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:3303:x1874625023792512:12345-0@lo:103:ldlm_bl.0 Request processed in 354us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782077.118690:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782077.118830:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3303:1874625023792512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782077.119025:0:14811:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782077.119035:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782077.119041:0:14811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef450ba2e00/0x3ad9816c904550f4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782077.501984:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782078.531178:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787782078.781888:0:14375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787782078.781896:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef4818d0000 from 10 10000000:01000000:2.0:1787782078.781902:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787782078.781949:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782078.781972:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782078.781984:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782078.782023:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023792640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787782078.782098:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782078.782158:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fabe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782078.782506:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023792640 00000100:00100000:1.0:1787782078.782515:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023792640 00000100:00100000:1.0:1787782078.782560:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787782078.782569:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+11:14375:x1874625023792640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782078.782582:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782078.782596:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c904550fb expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782078.782616:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c904550fb expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782078.782625:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904550fb expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782078.782645:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183fc00, rc 0) 00000100:00100000:1.0:1787782078.782691:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14375:x1874625023792640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782078.782698:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787782078.782830:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023792640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782078.782845:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782078.782853:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782078.782904:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023792768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782078.782928:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782078.782968:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fabe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782078.783017:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023792768 00000100:00100000:3.0:1787782078.783021:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023792768 00000100:00100000:3.0:1787782078.783047:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787782078.783053:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14375:x1874625023792768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782078.783382:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14375:x1874625023792768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782078.783390:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787782078.783642:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023792768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782078.783678:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023792896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782078.783715:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782078.783740:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fabe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782078.783811:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023792896 00000100:00100000:0.0:1787782078.783815:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023792896 00000100:00100000:0.0:1787782078.783836:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787782078.783843:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14375:x1874625023792896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782078.784196:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:14375:x1874625023792896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 353us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782078.784204:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787782078.786785:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023792896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787782078.788345:0:14872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787782078.788760:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787782078.788835:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782078.788850:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782078.788863:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782079.170548:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782069/real 1787782069] req@ffff9ef47695da40 x1874625023789568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782079 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782079.170578:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef47695da40 x1874625023789568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782079 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782079.170590:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782069/real 1787782069] req@ffff9ef47f3e4b40 x1874625023789440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782079 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782079.170601:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef47f3e4b40 x1874625023789440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782079 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787782079.170669:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef47f5b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782079.170688:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787782079.170692:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023789568:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787782079.170698:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef478b0a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782079.170703:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787782079.170706:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023789440:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787782079.170849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787782079.170854:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787782079.170857:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ef478b0a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782079.170863:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1787782079.170868:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787782079.170876:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ef478b0a800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1787782079.170909:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47932cb40 x1874625023793024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787782079.170925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787782079.170943:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787782079.170945:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ef47f5b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782079.170949:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1787782079.170951:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787782079.170955:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef47f5b1000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1787782079.170967:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47932cf00 x1874625023793152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782079.171019:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782079.171029:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023793280:0@lo:400:kworker.0 00000100:00100000:3.0:1787782079.171089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782079.171561:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023793024:0@lo:8:kworker.0 00000400:00000100:2.0:1787782079.171592:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874625023793024 offset 0 length 520: 4 00000100:00100000:2.0:1787782079.171613:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023793152:0@lo:8:kworker.0 00000400:00000100:2.0:1787782079.171630:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874625023793152 offset 0 length 520: 4 00000100:00100000:2.0:1787782079.171670:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023793280 00000100:00100000:2.0:1787782079.171677:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023793280 00000100:00100000:2.0:1787782079.171725:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782079.171735:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023793280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782079.171816:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023793280:12345-0@lo:400:kworker.0 Request processed in 82us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782079.171824:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787782079.171890:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef47932f0c0 x1874625023793280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782079.171905:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023793280:0@lo:400:kworker.0 00010000:00010000:0.0:1787782079.551011:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782080.575008:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787782081.022403:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787782081.598450:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782082.623445:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787782082.716069:0:15059:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787782082.716075:0:15059:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787782082.716225:0:15059:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ef444cb3000 00000020:01000004:1.0:1787782082.716246:0:15059:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787782082.716270:0:15059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787782082.716320:0:15059:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ef477d00000) 00000020:00000080:1.0:1787782082.716342:0:15059:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787782082.740057:0:15059:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787782082.740534:0:15059:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787782082.741780:0:15059:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787782082.742600:0:15059:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787782082.742855:0:15059:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787782082.743559:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787782082.743664:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787782082.743845:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787782082.744687:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 589: rc = 0 00100000:10000000:2.0:1787782082.745198:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 589: rc = 0 00100000:10000000:2.0:1787782082.745620:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 589: rc = 0 00100000:10000000:2.0:1787782082.746405:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 589: rc = 0 00100000:10000000:2.0:1787782082.746964:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 589: rc = 0 00100000:10000000:2.0:1787782082.747228:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 589: rc = 0 00000020:00000080:2.0:1787782082.748052:0:15059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787782082.748064:0:15059:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787782082.748201:0:15059:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3ad9816c90455110 00000020:01000004:2.0:1787782082.748210:0:15059:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787782082.748233:0:15059:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787782082.748236:0:15059:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787782082.748243:0:15059:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787782082.748247:0:15059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787782082.748266:0:15059:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ef478eb3370) 00000020:00000080:2.0:1787782082.748354:0:15059:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787782082.751945:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782082.752141:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787782082.752149:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787782082.753003:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787782082.753012:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787782082.753556:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787782082.753563:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787782082.755741:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782082.757051:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787782082.757059:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787782082.759408:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787782082.759425:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787782082.788860:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787782082.789111:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787782082.789118:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787782082.794867:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787782082.794882:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787782082.796256:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787782082.796281:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787782082.802763:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782082.803217:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787782082.803223:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787782082.816862:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787782082.816884:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787782082.867344:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782082.867564:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787782082.867571:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787782082.874590:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787782082.874613:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787782082.886188:0:15059:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787782082.886238:0:15059:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787782082.886246:0:15059:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787782082.921252:0:15059:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787782082.921377:0:15059:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787782082.921383:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787782082.921384:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787782082.921386:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782082.921387:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782082.921388:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782082.921390:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782082.921391:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782082.921397:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782082.921398:0:15059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787782082.921402:0:15059:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787782082.921404:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787782082.921405:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787782082.921406:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782082.921407:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782082.921408:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782082.921409:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782082.921410:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782082.921411:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782082.921412:0:15059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787782082.921449:0:15059:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787782082.921470:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793408:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787782082.921612:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782082.921894:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023793408 00000100:00100000:3.0:1787782082.921902:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023793408 00000100:00100000:3.0:1787782082.921960:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787782082.921969:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:15059:x1874625023793408:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787782082.922000:0:14372:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787782082.922004:0:14372:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787782082.922008:0:14372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787782082.922231:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fab300 going to sleep for 11 seconds 00000100:00100000:3.0:1787782082.927442:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:15059:x1874625023793408:12345-0@lo:253:mount.lustre.0 Request processed in 5462us (5818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782082.927461:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787782082.927587:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793408:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787782082.927607:0:15059:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787782082.927610:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787782082.927612:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787782082.927613:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782082.927614:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782082.927616:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782082.927617:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782082.927618:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782082.927620:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782082.927622:0:15059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787782082.927642:0:15059:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef444cb3000 from lustre-OST0000 10000000:01000000:1.0:1787782082.927669:0:15059:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787782082.927673:0:15059:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787782082.927679:0:15059:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ef478eb0000 local copy 00010000:00010000:1.0:1787782082.927689:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782082.927960:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782082.928006:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782082.928044:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782082.928152:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023793536 00000100:00100000:3.0:1787782082.928158:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023793536 00000100:00100000:3.0:1787782082.928198:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787782082.928207:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:15059:x1874625023793536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782082.928397:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:15059:x1874625023793536:12345-0@lo:501:mount.lustre.0 Request processed in 190us (390us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787782082.928404:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787782082.928782:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793536:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787782082.928817:0:15059:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787782082.928949:0:15059:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787782082.928956:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782082.928965:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782082.928992:0:15059:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef444cb3000 10000000:01000000:1.0:1787782082.928997:0:15059:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787782082.929001:0:15059:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ef478eb0000 10000000:01000000:1.0:1787782082.929003:0:15059:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787782082.929007:0:15059:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ef478eb0000 from 1 10000000:01000000:1.0:1787782082.929009:0:15059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787782082.929033:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183fa00/0x3ad9816c9045511e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782082.929041:0:15059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef48183fa00/0x3ad9816c9045511e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782082.929050:0:15059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef48183fa00/0x3ad9816c9045511e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782082.929064:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782082.929092:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782082.929183:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782082.932691:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023793664 00000100:00100000:3.0:1787782082.932708:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023793664 00000100:00100000:3.0:1787782082.932783:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787782082.932808:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+12:15059:x1874625023793664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782082.932825:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782082.933120:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef450ba3e00/0x3ad9816c90455125 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c9045511e expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782082.933217:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef450ba3e00/0x3ad9816c90455125 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c9045511e expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782082.933231:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef450ba3e00/0x3ad9816c90455125 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c9045511e expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782082.933240:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba3e00, rc 0) 00000100:00100000:3.0:1787782082.933364:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+13:15059:x1874625023793664:12345-0@lo:101:mount.lustre.0 Request processed in 557us (4269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782082.933371:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787782082.933425:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782082.933444:0:15059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef48183fa00/0x3ad9816c9045511e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455125 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782082.933453:0:15059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef48183fa00/0x3ad9816c9045511e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90455125 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782082.933476:0:15059:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787782082.933606:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183fa00/0x3ad9816c9045511e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455125 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782082.933616:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef48183fa00/0x3ad9816c9045511e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455125 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782082.933625:0:15059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787782082.933634:0:15059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782082.933655:0:15059:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787782082.933658:0:15059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787782082.933756:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9000/0x3ad9816c9045512c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782082.933764:0:15059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9000/0x3ad9816c9045512c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782082.933773:0:15059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9000/0x3ad9816c9045512c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782082.933831:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782082.933870:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782082.933898:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44884fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782082.933902:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023793792 00000100:00100000:1.0:1787782082.933907:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023793792 00000100:00100000:1.0:1787782082.933941:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787782082.933951:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+13:15059:x1874625023793792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782082.933960:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782082.933970:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef48183ee00/0x3ad9816c90455133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c9045512c expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782082.933985:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183ee00/0x3ad9816c90455133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c9045512c expref: 14 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782082.933994:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef48183ee00/0x3ad9816c90455133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c9045512c expref: 14 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782082.934000:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183ee00, rc 0) 00000100:00100000:1.0:1787782082.934042:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023793792:12345-0@lo:101:mount.lustre.0 Request processed in 93us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782082.934049:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787782082.934778:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782082.934829:0:15059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9000/0x3ad9816c9045512c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455133 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782082.934839:0:15059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9000/0x3ad9816c9045512c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90455133 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782082.937487:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787782082.938463:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782082.938687:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787782082.938726:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787782082.938752:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787782082.938843:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787782082.938880:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787782082.938906:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787782082.938970:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787782082.938982:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787782082.939063:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782082.939129:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782082.939171:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44884fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782082.942534:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023793920 00000100:00100000:1.0:1787782082.942547:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023793920 00000100:00100000:1.0:1787782082.942609:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787782082.942619:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023793920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782082.943048:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023793920:12345-0@lo:501:mount.lustre.0 Request processed in 429us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782082.943056:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787782082.943418:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023793920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782082.943467:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794048:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782082.943871:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782082.943946:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44884fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782082.950464:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023794048 00000100:00100000:0.0:1787782082.950480:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023794048 00000100:00100000:2.0:1787782082.950596:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787782082.950607:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023794048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782082.951071:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023794048:12345-0@lo:503:mount.lustre.0 Request processed in 464us (7200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782082.951079:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787782082.951229:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794048:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787782082.954099:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787782082.954213:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782082.954596:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782082.954650:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478fab900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782082.954675:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023794176 00000100:00100000:0.0:1787782082.954683:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023794176 00000100:00100000:0.0:1787782082.954808:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787782082.954818:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023794176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782082.955330:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023794176:12345-0@lo:502:mount.lustre.0 Request processed in 511us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782082.955339:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787782082.957769:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782082.958414:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787782082.958471:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787782082.958498:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787782082.958539:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787782082.958568:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787782082.958594:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787782082.958629:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787782082.958656:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787782082.958686:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787782082.958750:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787782082.958839:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787782082.958897:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787782082.958938:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782082.959007:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782082.959048:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44884fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782082.959231:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023794304 00000100:00100000:0.0:1787782082.959239:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023794304 00000100:00100000:0.0:1787782082.959310:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787782082.959320:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023794304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782082.959545:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023794304:12345-0@lo:502:mount.lustre.0 Request processed in 226us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782082.959553:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787782082.960306:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782082.960415:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787782082.960430:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787782082.962416:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787782082.962428:0:15073:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787782082.962435:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782082.962437:0:15073:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787782082.962443:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787782082.962460:0:15073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ef477d03370) 00000020:00000080:1.0:1787782082.962487:0:15073:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787782082.962493:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787782082.962748:0:15073:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef444cb3000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787782082.962757:0:15073:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787782082.962763:0:15073:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3ad9816c90455141 00010000:00010000:2.0:1787782082.968646:0:15073:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787782082.969093:0:15073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787782082.971214:0:15073:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787782082.977523:0:15073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787782082.977537:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782082.977544:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782082.977547:0:15073:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787782082.977551:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787782082.977554:0:15073:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787782082.977556:0:15073:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782082.977558:0:15073:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782082.977566:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787782082.977569:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782082.977570:0:15073:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787782082.977573:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782082.977576:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782082.977578:0:15073:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787782082.977581:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787782082.977583:0:15073:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787782082.977585:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782082.977587:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782082.977588:0:15073:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787782082.977591:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782082.977593:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782082.977594:0:15073:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787782082.977597:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787782082.977667:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782082.977671:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782082.977673:0:15073:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787782082.977676:0:15073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787782082.977851:0:15059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787782082.977879:0:15059:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787782082.977902:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9000/0x3ad9816c9045512c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455133 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782082.977913:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9000/0x3ad9816c9045512c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455133 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782082.977921:0:15059:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef444cb3000 from 1 10000000:01000000:2.0:1787782082.977923:0:15059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787782082.977958:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782082.977965:0:15059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782082.977975:0:15059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782082.977999:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782082.978061:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782082.978109:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44884fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782082.978350:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023794432 00000100:00100000:3.0:1787782082.978358:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023794432 00000100:00100000:3.0:1787782082.978406:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787782082.978415:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+14:15059:x1874625023794432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782082.978428:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782082.978441:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455148 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782082.978462:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455148 expref: 15 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782082.978473:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455148 expref: 15 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782082.978492:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef450ba2c00, rc 0) 00000100:00100000:3.0:1787782082.978533:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023794432:12345-0@lo:101:mount.lustre.0 Request processed in 119us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782082.978541:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787782082.978664:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782082.978678:0:15059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782082.978687:0:15059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782082.982391:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787782082.982760:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782082.983055:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787782082.983101:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787782082.984478:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787782082.984499:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787782082.984598:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782082.984669:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782082.984715:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44884fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782082.984758:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023794560 00000100:00100000:1.0:1787782082.984765:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023794560 00000100:00100000:1.0:1787782082.984825:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787782082.984834:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023794560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782082.985038:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023794560:12345-0@lo:501:mount.lustre.0 Request processed in 205us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782082.985047:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787782082.985855:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782082.985897:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782082.985945:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782082.985969:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44884fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782082.986092:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023794688 00000100:00100000:0.0:1787782082.986097:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023794688 00000100:00100000:0.0:1787782082.986134:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787782082.986284:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023794688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782082.986462:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023794688:12345-0@lo:503:mount.lustre.0 Request processed in 249us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782082.986471:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787782082.986547:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794688:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787782082.987047:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787782082.987104:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782082.988035:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782082.988116:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44884fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782082.993386:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023794816 00000100:00100000:0.0:1787782082.993402:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023794816 00000100:00100000:0.0:1787782082.993488:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787782082.993499:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023794816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782082.993778:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023794816:12345-0@lo:502:mount.lustre.0 Request processed in 280us (5743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782082.993806:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787782082.997856:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782082.998501:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787782082.998575:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787782082.998627:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787782082.998665:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787782082.998717:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787782082.998768:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787782082.998879:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787782082.998913:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787782082.998954:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782082.999028:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782082.999287:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef44884fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782083.006218:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023794944 00000100:00100000:3.0:1787782083.006235:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023794944 00000100:00100000:3.0:1787782083.006352:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787782083.006364:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023794944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782083.006637:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023794944:12345-0@lo:502:mount.lustre.0 Request processed in 276us (7608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782083.006646:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787782083.006760:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023794944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782083.006964:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787782083.006985:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787782083.008951:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782083.008964:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782083.008967:0:15077:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787782083.008974:0:15077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef444cb3000 00000020:00000080:1.0:1787782083.008977:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782083.008984:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782083.008986:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782083.008988:0:15077:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787782083.009001:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782083.009004:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782083.009005:0:15077:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787782083.009009:0:15077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef444cb3000 00000020:00000080:1.0:1787782083.009011:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782083.009086:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782083.009091:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782083.009092:0:15077:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787782083.009095:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782083.009097:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782083.009099:0:15077:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787782083.009102:0:15077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef444cb3000 00000020:00000080:1.0:1787782083.009104:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782083.009150:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782083.009154:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782083.009156:0:15077:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787782083.009159:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787782083.015266:0:15059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787782083.026160:0:15059:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782083.026193:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.026207:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782083.026262:0:15059:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787782083.026266:0:15059:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef444cb3000 10000000:01000000:2.0:1787782083.026269:0:15059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef444cb3000 10000000:01000000:2.0:1787782083.026273:0:15059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782083.026280:0:15059:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef444cb3000 from 1 10000000:01000000:2.0:1787782083.026283:0:15059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787782083.026329:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8e00/0x3ad9816c90455156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.026346:0:15059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8e00/0x3ad9816c90455156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.026358:0:15059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8e00/0x3ad9816c90455156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782083.026384:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782083.026451:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782083.026496:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448c9a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782083.028273:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023795072 00000100:00100000:2.0:1787782083.028286:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023795072 00000100:00100000:2.0:1787782083.028390:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787782083.028401:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023795072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782083.028417:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782083.028433:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8200/0x3ad9816c9045515d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455156 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.028461:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8200/0x3ad9816c9045515d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455156 expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.028472:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8200/0x3ad9816c9045515d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455156 expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.028481:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8200, rc 0) 00000100:00100000:2.0:1787782083.028547:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795072:12345-0@lo:101:mount.lustre.0 Request processed in 148us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782083.028555:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787782083.036993:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782083.037028:0:15059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8e00/0x3ad9816c90455156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045515d expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782083.037042:0:15059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8e00/0x3ad9816c90455156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045515d expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782083.038907:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787782083.040544:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782083.040907:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787782083.040959:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787782083.040992:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787782083.041053:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787782083.041092:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787782083.042271:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787782083.042353:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787782083.042405:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787782083.042458:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787782083.042494:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787782083.042528:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787782083.042595:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787782083.042633:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787782083.042665:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787782083.042725:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787782083.042765:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787782083.042822:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787782083.042871:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787782083.042909:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787782083.042943:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787782083.043005:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787782083.043041:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787782083.043075:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787782083.043120:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787782083.045354:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787782083.045410:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787782083.045487:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787782083.045550:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787782083.045641:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787782083.045649:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787782083.045763:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782083.046360:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782083.046400:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801840 going to sleep for 11 seconds 00000100:00100000:2.0:1787782083.046507:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023795200 00000100:00100000:2.0:1787782083.046514:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023795200 00000100:00100000:2.0:1787782083.046564:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787782083.046572:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782083.047073:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795200:12345-0@lo:501:mount.lustre.0 Request processed in 499us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782083.047082:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787782083.057397:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782083.058784:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782083.058893:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782083.058939:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448c9a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782083.059920:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023795328 00000100:00100000:0.0:1787782083.059930:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023795328 00000100:00100000:0.0:1787782083.059989:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787782083.059997:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782083.060210:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795328:12345-0@lo:503:mount.lustre.0 Request processed in 213us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782083.060218:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787782083.062921:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795328:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787782083.063549:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787782083.063632:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782083.063714:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782083.063768:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef448c9a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782083.064317:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023795456 00000100:00100000:0.0:1787782083.064325:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023795456 00000100:00100000:0.0:1787782083.064381:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787782083.064390:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782083.064630:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795456:12345-0@lo:502:mount.lustre.0 Request processed in 240us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782083.064638:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787782083.064745:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782083.065036:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787782083.065091:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787782083.065128:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787782083.065202:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787782083.065254:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787782083.065317:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787782083.065356:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787782083.065392:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787782083.065443:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787782083.065479:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787782083.065513:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787782083.065562:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787782083.065597:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787782083.065629:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787782083.065691:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787782083.065727:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787782083.065760:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787782083.065852:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787782083.065891:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787782083.065924:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787782083.065988:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787782083.066030:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787782083.066065:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787782083.066115:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787782083.066151:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787782083.066185:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787782083.066229:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787782083.066264:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787782083.066310:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787782083.066361:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787782083.066398:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787782083.066429:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787782083.066465:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787782083.066514:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787782083.066551:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787782083.066599:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787782083.066655:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787782083.066692:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787782083.066743:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787782083.066775:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787782083.066847:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782083.066923:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782083.066968:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18540 going to sleep for 11 seconds 00000100:00100000:0.0:1787782083.068696:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023795584 00000100:00100000:0.0:1787782083.068709:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023795584 00000100:00100000:0.0:1787782083.068775:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787782083.068784:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782083.069084:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795584:12345-0@lo:502:mount.lustre.0 Request processed in 300us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782083.069092:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787782083.072688:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782083.073306:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787782083.073333:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787782083.084568:0:15082:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787782083.084587:0:15082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ef481fc3370) 00000020:00000080:3.0:1787782083.084622:0:15082:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787782083.084693:0:15082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef444cb3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787782083.084708:0:15082:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef444cb3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787782083.084711:0:15082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef444cb3000 3 00010000:00080000:3.0:1787782083.084739:0:15082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef444bc7000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1787782083.087277:0:15082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787782083.087481:0:15082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787782083.087521:0:15082:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787782083.087532:0:15082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3ad9816c9045516b 00000100:00080000:2.0:1787782083.087543:0:15082:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782083.087548:0:15082:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ef444bc7000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1787782083.087585:0:15082:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47695fc00 x1874625023795712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782083.087620:0:15082:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787782083.087843:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874625023795712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787782083.088041:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787782083.088202:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782083.088207:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787782083.088210:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782083.088213:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787782083.088344:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782083.088360:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023795840:0@lo:400:kworker.0 00000100:00100000:3.0:1787782083.088389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782083.092849:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023795712 00000100:00100000:2.0:1787782083.092865:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023795712 00000100:00100000:2.0:1787782083.092908:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023795840 00000100:00100000:2.0:1787782083.092911:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023795840 00000100:00100000:2.0:1787782083.092938:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782083.092946:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023795840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782083.095155:0:14379:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787782083.095169:0:14379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787782083.095542:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023795840:12345-0@lo:400:kworker.0 Request processed in 2592us (7147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782083.095553:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782083.095583:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782083.095590:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874625023795712:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787782083.095630:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1787782083.095675:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3ad9816c90455172 00000004:00100000:2.0:1787782083.095694:0:14377:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787782083.095729:0:14377:0:(import.c:65:import_set_state_nolock()) ffff9ef45cd51800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782083.095826:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874625023795712:12345-0@lo:38:llog_process_th.0 Request processed in 235us (7785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782083.095833:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1787782083.095993:0:15082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:0.0:1787782083.096518:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef47695fc00 x1874625023795712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782083.096530:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787782083.096538:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787782083.096547:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787782083.096551:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787782083.096554:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef444bc7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787782083.096560:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874625023795712:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1787782083.097125:0:15059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787782083.097221:0:15059:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787782083.097240:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8e00/0x3ad9816c90455156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045515d expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782083.097251:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8e00/0x3ad9816c90455156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045515d expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787782083.097307:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787782083.097309:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787782083.097311:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782083.097312:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782083.097313:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782083.097315:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782083.097316:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782083.097318:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782083.097319:0:15059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787782083.097323:0:15059:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787782083.097325:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787782083.097327:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787782083.097328:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782083.097329:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782083.097330:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782083.097331:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782083.097332:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782083.097333:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782083.097334:0:15059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787782083.097353:0:15059:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787782083.097374:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795968:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787782083.097428:0:15059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782083.097463:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f590480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782083.098253:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023795968 00000100:00100000:2.0:1787782083.098261:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023795968 00000100:00100000:2.0:1787782083.098315:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787782083.098325:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15059:x1874625023795968:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787782083.098352:0:14373:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787782083.098367:0:14373:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787782083.101516:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ef47f3e7480 x1874625023795840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782083.101536:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023795840:0@lo:400:kworker.0 20000000:01000000:2.0:1787782083.143463:0:14373:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787782083.143515:0:14373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787782083.146402:0:14394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787782083.146410:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787782083.146429:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782083.146443:0:14394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904550df expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782083.146450:0:14394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782083.146488:0:14394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c904550df expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782083.146500:0:14394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c904550df expref: 16 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782083.146514:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479334000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874625023796096:0@lo:104: 00000100:00100000:0.0:1787782083.146583:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782083.146645:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef473d596c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782083.146765:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023796096 00000100:00100000:2.0:1787782083.146772:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023796096 00000100:00100000:2.0:1787782083.146854:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782083.146872:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479334780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:14394:x1874625023796096:12345-0@lo:104: 00010000:00010000:2.0:1787782083.146885:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.146937:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787782083.146943:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479334780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:14394:x1874625023796096:12345-0@lo:104: Request processed in 74us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782083.146951:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787782083.146984:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782083.146991:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.146998:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f800 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:2.0:1787782083.147003:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147012:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782083.147020:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782083.147026:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787782083.147055:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147061:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782083.147080:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147098:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c904550df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c904550e6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147114:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782083.147116:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782083.147118:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782083.147145:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782083.147158:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023796224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782083.147189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782083.147223:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023796224 00000100:00100000:2.0:1787782083.147228:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023796224 00010000:00010000:2.0:1787782083.147245:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904550df expref: 17 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782083.147265:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782083.147271:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:3305:x1874625023796224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782083.147282:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782083.147286:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904550df expref: 17 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147307:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c904550df expref: 17 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147325:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147333:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787782083.147359:0:14365:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001459333s 00010000:00010000:2.0:1787782083.147363:0:14365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147369:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147376:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147383:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147388:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787782083.147392:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147400:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147408:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147417:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782083.147446:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:3305:x1874625023796224:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782083.147454:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782083.147491:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023796224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782083.147524:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440030a00/0x3ad9816c904550e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c904550df expref: 16 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782083.147540:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479334000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874625023796096:0@lo:104: 00010000:00010000:2.0:1787782083.147552:0:14394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147560:0:14394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147566:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782083.147572:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455179 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782083.181776:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:15059:x1874625023795968:12345-0@lo:253:mount.lustre.0 Request processed in 83442us (84335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782083.181834:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787782083.181980:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15059:1874625023795968:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787782083.181996:0:15059:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787782083.182000:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782083.182002:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782083.182003:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782083.182004:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782083.182005:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782083.182006:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782083.182008:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782083.182009:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782083.182011:0:15059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787782083.182024:0:15059:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787782083.186540:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782083.186712:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782083.187363:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782083.187528:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782083.187960:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782083.188216:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787782083.188898:0:15059:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787782083.227246:0:15059:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787782083.227254:0:15059:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787782083.227280:0:15059:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787782083.227346:0:15059:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787782083.227361:0:15059:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787782083.227389:0:15059:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787782083.646069:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787782084.542041:0:14375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787782084.542050:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef4818d0000 from 7 10000000:01000000:2.0:1787782084.542055:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787782084.542102:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782084.542126:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782084.542138:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782084.542166:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023796352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787782084.542247:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782084.542311:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4622f5780 going to sleep for 11 seconds 00000100:00100000:1.0:1787782084.542401:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023796352 00000100:00100000:1.0:1787782084.542408:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023796352 00000100:00100000:1.0:1787782084.542464:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787782084.542473:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+15:14375:x1874625023796352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782084.542486:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782084.542501:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455180 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782084.542523:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455180 expref: 16 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782084.542534:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455180 expref: 16 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782084.542542:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f000, rc 0) 00000100:00100000:1.0:1787782084.542583:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:14375:x1874625023796352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782084.542590:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787782084.542722:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023796352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782084.542736:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782084.542745:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782084.542832:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023796480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787782084.542863:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782084.542881:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4622f5780 going to sleep for 11 seconds 00000100:00100000:1.0:1787782084.542940:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023796480 00000100:00100000:1.0:1787782084.542945:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023796480 00000100:00100000:1.0:1787782084.542976:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787782084.542983:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:14375:x1874625023796480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787782084.543004:0:14373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787782084.543018:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787782084.543021:0:14373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787782084.543095:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:14375:x1874625023796480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782084.543102:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787782084.543131:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023796480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787782084.543186:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787782084.543192:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782084.543200:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782084.675368:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782085.699473:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782086.718871:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782087.746811:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787782088.388097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782088.388105:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782088.388107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782088.388110:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787782088.388170:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023796736:0@lo:400:kworker.0 00000100:00100000:2.0:1787782088.388383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782088.388443:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782088.388450:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3304:1874625023796608:0@lo:400:kworker.0 00000100:00100000:2.0:1787782088.388479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782088.388512:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023796864:0@lo:400:kworker.0 00000100:00100000:2.0:1787782088.388540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782088.388574:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023796736 00000100:00100000:2.0:1787782088.388581:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023796736 00000100:00100000:2.0:1787782088.388622:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023796864 00000100:00100000:2.0:1787782088.388625:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023796864 00000100:00100000:2.0:1787782088.388661:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782088.388670:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023796736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782088.388784:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023796736:12345-0@lo:400:kworker.0 Request processed in 114us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782088.388814:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782088.388832:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782088.388839:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023796864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782088.388871:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023796864:12345-0@lo:400:kworker.0 Request processed in 33us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782088.388877:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782088.388895:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023796608 00000100:00100000:2.0:1787782088.388898:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023796608 00000100:00100000:2.0:1787782088.388922:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787782088.388928:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:3304:x1874625023796608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782088.388955:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:3304:x1874625023796608:12345-0@lo:400:kworker.0 Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782088.388970:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787782088.389024:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef47695c3c0 x1874625023796864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782088.389038:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023796864:0@lo:400:kworker.0 00000100:00100000:2.0:1787782088.389064:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3304:1874625023796608:0@lo:400:kworker.0 00010000:00080000:2.0:1787782088.389074:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef47695f840 x1874625023796736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782088.389082:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023796736:0@lo:400:kworker.0 00000100:00080000:0.0:1787782088.389409:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787782088.775466:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782089.790311:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787782090.496109:0:15427:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787782090.816350:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782091.262641:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787782091.847425:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782092.862978:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782093.501983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782093.501990:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787782093.501992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787782093.501995:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787782093.502054:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479336d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023797120:0@lo:400:kworker.0 00000100:00100000:0.0:1787782093.502131:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782093.502191:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782093.502197:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023797248:0@lo:400:kworker.0 00000100:00100000:0.0:1787782093.502232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782093.502269:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023797120 00000100:00100000:0.0:1787782093.502275:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023797120 00000100:00100000:0.0:1787782093.502313:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023797248 00000100:00100000:0.0:1787782093.502316:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023797248 00000100:00100000:0.0:1787782093.502339:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782093.502346:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479337840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023797120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782093.502390:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479337840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023797120:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782093.502397:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782093.502411:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782093.502416:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4793370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023797248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782093.502435:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4793370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023797248:12345-0@lo:400:kworker.0 Request processed in 20us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782093.502446:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787782093.502466:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787782093.502496:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef479335a40 x1874625023797248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782093.502510:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479335a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023797248:0@lo:400:kworker.0 00010000:00080000:0.0:1787782093.502518:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef479336d00 x1874625023797120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782093.502525:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479336d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023797120:0@lo:400:kworker.0 00000100:00100000:1.0:1787782093.502637:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782093.502646:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4793352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023796992:0@lo:400:kworker.0 00000100:00100000:1.0:1787782093.502676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782093.502761:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023796992 00000100:00100000:0.0:1787782093.502765:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023796992 00000100:00100000:0.0:1787782093.502823:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782093.502830:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:3305:x1874625023796992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782093.502860:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:3305:x1874625023796992:12345-0@lo:400:kworker.0 Request processed in 31us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782093.502866:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782093.502893:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4793352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023796992:0@lo:400:kworker.0 00010000:00010000:1.0:1787782093.891029:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782094.334104:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782079/real 1787782079] req@ffff9ef47932cb40 x1874625023793024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782094 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782094.334272:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef47932cb40 x1874625023793024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782094 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782094.334282:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782079/real 1787782079] req@ffff9ef47932cf00 x1874625023793152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782094 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782094.334292:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ef47932cf00 x1874625023793152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782094 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787782094.334310:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef478b0a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782094.334335:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787782094.334339:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023793024:0@lo:8:kworker.0 00000100:00080000:2.0:1787782094.334344:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef47f5b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782094.334349:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787782094.334352:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023793152:0@lo:8:kworker.0 00000100:00080000:3.0:1787782094.334498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787782094.334503:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787782094.334505:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ef478b0a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782094.334510:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1787782094.334515:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787782094.334521:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ef478b0a800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1787782094.334542:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47932cf00 x1874625023797504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787782094.334568:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787782094.334572:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787782094.334574:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ef47f5b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787782094.334577:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1787782094.334580:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787782094.334583:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef47f5b1000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1787782094.334593:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47932cb40 x1874625023797632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782094.334642:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023797888:0@lo:400:kworker.0 00000100:00100000:3.0:1787782094.334700:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782094.334768:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023797888 00000100:00100000:3.0:1787782094.334774:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023797888 00000100:00100000:3.0:1787782094.334841:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782094.334850:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023797888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782094.334896:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023797888:12345-0@lo:400:kworker.0 Request processed in 46us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782094.334912:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787782094.334964:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef47932d680 x1874625023797888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782094.334976:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023797888:0@lo:400:kworker.0 00000100:00100000:1.0:1787782094.335057:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023797504:0@lo:8:kworker.0 00000100:00100000:1.0:1787782094.335091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782094.335130:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023797632:0@lo:8:kworker.0 00000100:00100000:1.0:1787782094.335155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782094.335190:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023797504 00000100:00100000:1.0:1787782094.335203:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023797504 00000100:00100000:1.0:1787782094.335222:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023797632 00000100:00100000:1.0:1787782094.335232:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023797632 00000100:00100000:1.0:1787782094.335246:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782094.335251:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1874625023797504:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787782094.335274:0:15061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:1.0:1787782094.335299:0:15061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c9045518e 00002000:00100000:1.0:1787782094.335312:0:15061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ef47f837800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787782094.335316:0:15061:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787782094.335319:0:15061:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787782094.335632:0:15061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787782094.335654:0:15061:0:(import.c:65:import_set_state_nolock()) ffff9ef47f830800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787782094.335694:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874625023797504:12345-0@lo:8:kworker.0 Request processed in 441us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782094.335702:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782094.335716:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782094.335720:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1874625023797632:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787782094.335731:0:15061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787782094.335755:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1874625023797632:12345-0@lo:8:kworker.0 Request processed in 33us (599us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787782094.335761:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787782094.335816:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef47932cf00 x1874625023797504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787782114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782094.335825:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787782094.335832:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787782094.335839:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787782094.335844:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787782094.335846:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef478b0a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787782094.335862:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787782094.335867:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023797504:0@lo:8:kworker.0 00000100:00080000:1.0:1787782094.335879:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef47f5b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782094.335883:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787782094.335886:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023797632:0@lo:8:kworker.0 00000100:00100000:2.0:1787782094.336175:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023797760:0@lo:400:kworker.0 00000100:00100000:2.0:1787782094.336218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782094.336249:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787782094.336255:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3306:1874625023797376:0@lo:400:kworker.0 00000100:00100000:2.0:1787782094.336281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787782094.336335:0:14401:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787782094.336351:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14401:1874625023798144:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787782094.336375:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782094.336386:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef476884780 going to sleep for 11 seconds 00000004:00080000:2.0:1787782094.336399:0:14400:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787782094.336625:0:14400:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 462114834824ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787782094.336646:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023797376 00000100:00100000:2.0:1787782094.336651:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023797376 00000100:00100000:2.0:1787782094.336677:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787782094.336684:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:3306:x1874625023797376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782094.336723:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:3306:x1874625023797376:12345-0@lo:400:kworker.0 Request processed in 39us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782094.336730:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787782094.336762:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3306:1874625023797376:0@lo:400:kworker.0 00000100:00100000:3.0:1787782094.336872:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023798144 00000100:00100000:3.0:1787782094.336877:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023798144 00000100:00100000:3.0:1787782094.336917:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782094.337494:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023798016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782094.337552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782094.337590:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023798016 00000100:00100000:0.0:1787782094.337594:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023798016 00000100:00100000:0.0:1787782094.337616:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782094.337622:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4793352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874625023798016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787782094.337648:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782094.337684:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4793352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874625023798016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782094.337696:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787782094.337724:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef47695c780 x1874625023798016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782094.337740:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023798016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782094.338240:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14401:x1874625023798144:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1787782094.339251:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782094.340347:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023797760 00000100:00100000:1.0:1787782094.340359:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023797760 00000100:00100000:1.0:1787782094.340408:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787782094.340418:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023797760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782094.340501:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023797760:12345-0@lo:400:kworker.0 Request processed in 84us (4282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782094.340508:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787782094.340567:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef47932da40 x1874625023797760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782094.340581:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023797760:0@lo:400:kworker.0 00002000:00080000:3.0:1787782094.355892:0:15060:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787782094.355904:0:15060:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787782094.355910:0:15060:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1787782094.372366:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.372380:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372399:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.372404:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.372412:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372431:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372442:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372464:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372484:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.372499:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.372506:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372515:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.372520:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372529:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372547:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372554:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9278c0c/0x3ad9816c90455195 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.372571:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.372573:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.372575:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.373064:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.373079:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.373089:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.373093:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.373098:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.373108:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.373116:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.373122:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.373132:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787782094.374463:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.374473:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374486:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.374490:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.374496:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374508:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374523:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374532:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374554:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787782094.374571:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782094.374577:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374585:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.374590:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374598:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374613:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374620:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000080a5128/0x3ad9816c9045519c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374637:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.374646:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374652:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.374655:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374662:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374672:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374678:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce8cebc6/0x3ad9816c904551a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.374690:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.374691:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.374693:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782094.375248:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.375521:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.375529:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375541:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.375545:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.375551:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375575:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375585:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375594:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375610:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.375619:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.375623:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375631:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.375634:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375643:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375655:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375663:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ddecd6e/0x3ad9816c904551aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.375683:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.375685:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.375686:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.378425:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.378438:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378454:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.378459:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.378466:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378481:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378492:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378500:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378523:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.378535:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.378541:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378562:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2a00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.378566:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378575:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378591:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378598:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001deece71/0x3ad9816c904551b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.378615:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.378617:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.378619:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.379116:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.379122:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379130:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.379133:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.379138:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379147:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379176:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379184:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379214:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.379224:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.379229:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379237:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.379241:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379251:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379262:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379270:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042b8b061/0x3ad9816c904551b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379284:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.379293:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.379295:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.379675:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.379681:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379691:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.379694:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.379699:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379708:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379717:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379725:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379738:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.379746:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.379750:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379757:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.379760:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379779:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379812:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379820:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053df8b83/0x3ad9816c904551bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.379834:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.379836:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.379837:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.380514:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.380521:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380531:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.380535:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.380540:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380552:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380561:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380576:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380594:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.380604:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.380609:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380617:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.380620:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380627:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380640:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380647:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009649410d/0x3ad9816c904551c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.380661:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.380663:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.380665:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.383235:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.383258:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383277:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.383282:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.383288:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383303:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383314:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383323:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383341:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.383353:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.383359:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383366:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba2e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.383371:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383381:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383404:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383412:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003429ad68/0x3ad9816c904551cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383431:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.383433:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.383434:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.383896:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.383903:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383913:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.383916:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.383921:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383931:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383939:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383947:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383973:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.383982:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.383986:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.383994:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.383997:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.384006:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.384018:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.384025:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e77e6510/0x3ad9816c904551d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.384038:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.384040:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.384041:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.385008:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.385017:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.385030:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.385038:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.385044:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.385055:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.385065:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.385073:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.385091:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.385103:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.385107:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.385114:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef450ba3200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.385118:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.385125:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.385137:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.385995:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e247476/0x3ad9816c904551db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.386015:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.386017:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.386019:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.387388:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.387398:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387413:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.387419:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.387425:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387437:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387446:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387453:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387480:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787782094.387924:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.387939:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387948:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.387951:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.387956:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387966:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387974:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387982:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.387997:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787782094.388009:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782094.388014:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388021:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.388025:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388034:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388058:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388065:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c904551e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388082:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.388085:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388092:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.388095:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388104:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388113:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388120:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c904551e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388133:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.388134:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.388225:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.388670:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.388677:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388686:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.388690:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.388695:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388705:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388713:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388721:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388736:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.388743:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.388746:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388753:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.388756:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388774:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.388784:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.388848:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.389107:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c904551f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.389123:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.389125:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.389126:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.390958:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.390973:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.390990:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.390995:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.391002:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.391015:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.391025:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.391968:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.391994:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787782094.392849:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.392858:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.392871:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.392875:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.392881:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.392894:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.392904:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.392912:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.392932:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787782094.392947:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782094.392953:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.392967:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.392972:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.392981:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.392999:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.393007:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904551f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.393026:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.393030:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.394218:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.394224:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.394235:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.394251:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.394266:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c904551fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.394286:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.394288:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.394290:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782094.395282:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787782094.400937:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787782094.400951:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.400970:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1787782094.400982:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782094.400989:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.401006:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.401017:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.401025:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.402251:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787782094.402810:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787782094.402818:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.402833:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1787782094.402837:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782094.402843:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.402857:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.402867:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.402883:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782094.402900:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787782094.403438:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782094.403447:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403456:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.403462:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403472:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403489:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403498:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f40d3e6d/0x3ad9816c90455205 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403517:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.403521:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403537:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8a00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.403541:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403549:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403560:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403568:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026b7a0cf/0x3ad9816c9045520c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.403580:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.403581:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.403583:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782094.404521:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.407320:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.407335:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407353:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.407358:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.407365:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407381:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407400:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407409:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407427:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.407440:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.407446:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407454:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.407459:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407467:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407486:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407495:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001db8c269/0x3ad9816c90455213 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.407517:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.407525:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.407527:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.408518:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.408527:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.408540:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.408544:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.408549:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.408561:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.408570:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.408577:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.408593:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787782094.409067:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.409073:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409082:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.409085:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.409090:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409107:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409116:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409122:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409136:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787782094.409160:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782094.409166:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409173:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.409178:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409185:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409210:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409217:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c61fba/0x3ad9816c9045521a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409240:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.409244:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409250:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.409254:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409262:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409274:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409281:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed1ee4c1/0x3ad9816c90455221 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409293:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.409295:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.409296:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.409853:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.409859:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409869:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.409872:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.409884:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409894:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409903:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409911:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409926:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782094.409934:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782094.409938:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409945:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782094.409948:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409956:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409968:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.409987:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da73210e/0x3ad9816c90455228 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.410003:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.410005:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782094.410006:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.413740:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.419327:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.419341:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419359:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.419364:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.419371:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419386:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419397:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419406:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419428:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787782094.419926:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.419940:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419950:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.419953:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.419958:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419969:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419977:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419984:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.419998:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787782094.422503:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782094.422517:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422530:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782094.422535:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422546:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422570:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422577:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c9045522f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422602:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782094.422606:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422626:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782094.422628:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422636:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422647:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422655:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c90455236 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.422670:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.422671:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.422674:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.422682:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.422805:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.422814:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.422826:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.422831:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.422837:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.422849:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.422866:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.422874:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.422894:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782094.422992:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782094.422998:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.423006:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782094.423010:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.423018:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.423037:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.423046:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c960781a/0x3ad9816c9045523d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.423061:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.423065:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.423067:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.428636:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.428650:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.428667:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.428671:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.428676:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.428690:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.428700:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.428708:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.428745:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782094.428773:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782094.428782:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.428829:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782094.428834:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.428845:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.428865:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.428873:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c90455244 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.428908:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.428910:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.428912:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.429272:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.429278:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429287:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.429290:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.429295:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429304:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429312:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429320:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429337:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782094.429361:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782094.429368:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429378:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782094.429382:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429392:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429405:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429413:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c9045524b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429433:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.429435:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.429437:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782094.429760:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782094.429766:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429775:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1787782094.429784:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782094.429816:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429828:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429837:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429845:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782094.429866:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782094.429886:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782094.429892:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429912:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044a00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782094.429916:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429926:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429940:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429948:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f04195de/0x3ad9816c90455252 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782094.429966:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.429969:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782094.429972:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787782094.430076:0:15060:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1787782094.430175:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14401:x1874625023798144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93248us (93795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782094.430185:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782094.430264:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14401:1874625023798144:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787782094.430281:0:14401:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787782094.430334:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14401:1874625023798272:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787782094.430373:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782094.430428:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787782094.430491:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023798272 00000100:00100000:1.0:1787782094.430498:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023798272 00000100:00100000:1.0:1787782094.430536:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782094.430546:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14401:x1874625023798272:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787782094.430582:0:15062:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:0.0:1787782094.444458:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787782094.446144:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14401:x1874625023798272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15593us (15764us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787782094.446157:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782094.446300:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932d680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14401:1874625023798272:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787782094.446318:0:14401:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1787782094.914672:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782095.933944:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782096.958189:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782097.982693:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787782098.607921:0:15777:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787782098.607927:0:15777:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787782098.610447:0:15777:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ef479c77800 00000020:01000004:2.0:1787782098.610478:0:15777:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787782098.610498:0:15777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787782098.610578:0:15777:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ef478eb19b8) 00000020:00000080:2.0:1787782098.610603:0:15777:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787782098.685882:0:15777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787782098.687605:0:15777:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787782098.690172:0:15777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787782098.691989:0:15777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787782098.692300:0:15777:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787782098.693268:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 651: rc = 0 00100000:10000000:2.0:1787782098.693468:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 651: rc = 0 00100000:10000000:2.0:1787782098.693728:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 651: rc = 0 00100000:10000000:2.0:1787782098.695273:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 15: rc = 0 00100000:10000000:2.0:1787782098.696076:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 15: rc = 0 00100000:10000000:2.0:1787782098.696455:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 15: rc = 0 00100000:10000000:2.0:1787782098.696876:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 15: rc = 0 00100000:10000000:2.0:1787782098.697144:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 15: rc = 0 00100000:10000000:3.0:1787782098.700726:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 15: rc = 0 00000020:00000080:3.0:1787782098.718289:0:15777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787782098.718320:0:15777:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787782098.720742:0:15777:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3ad9816c90455260 00000020:01000004:3.0:1787782098.720764:0:15777:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787782098.720822:0:15777:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787782098.720827:0:15777:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787782098.720835:0:15777:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787782098.720872:0:15777:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787782098.720878:0:15777:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787782098.747776:0:15777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787782098.747865:0:15777:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.156@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787782098.747870:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787782098.747876:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782098.747878:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782098.747879:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782098.747881:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782098.747882:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782098.747884:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782098.747886:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782098.747887:0:15777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782098.747892:0:15777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787782098.747894:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782098.747895:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782098.747897:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782098.747898:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782098.747898:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782098.747899:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782098.747900:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782098.747902:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782098.747903:0:15777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782098.747953:0:15777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787782098.747979:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798400:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787782098.748070:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782098.748142:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023798400 00000100:00100000:2.0:1787782098.748164:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023798400 00000100:00100000:2.0:1787782098.748226:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787782098.748236:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15777:x1874625023798400:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787782098.748274:0:14373:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787782098.748278:0:14373:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787782098.748281:0:14373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787782098.748458:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f3b16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782098.769821:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15777:x1874625023798400:12345-0@lo:253:mount.lustre.0 Request processed in 21572us (21736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782098.769841:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787782098.769934:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798400:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787782098.769953:0:15777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787782098.769972:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782098.769973:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782098.769975:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782098.769976:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782098.769978:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782098.769979:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782098.769980:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782098.769982:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782098.769983:0:15777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787782098.770007:0:15777:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ef479c77800 from lustre-OST0001 10000000:01000000:2.0:1787782098.770040:0:15777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787782098.770043:0:15777:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787782098.770052:0:15777:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ef478eb0000 local copy 00010000:00010000:2.0:1787782098.770065:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782098.771978:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782098.772066:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782098.772116:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f3b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782098.772148:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023798528 00000100:00100000:2.0:1787782098.772169:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023798528 00000100:00100000:2.0:1787782098.772226:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787782098.772238:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15777:x1874625023798528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782098.773967:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15777:x1874625023798528:12345-0@lo:501:mount.lustre.0 Request processed in 1721us (1892us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787782098.773984:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787782098.776024:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798528:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787782098.776066:0:15777:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787782098.776488:0:15777:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787782098.776500:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782098.776525:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef450ba2600/0x3ad9816c90455006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045500d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782098.776573:0:15777:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ef479c77800 10000000:01000000:0.0:1787782098.776580:0:15777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787782098.776588:0:15777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787782098.776591:0:15777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787782098.776598:0:15777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787782098.776601:0:15777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787782098.776652:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90455267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782098.776661:0:15777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90455267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782098.776674:0:15777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90455267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782098.776702:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479334f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787782098.776832:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782098.776886:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4467509c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782098.777074:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023798656 00000100:00100000:3.0:1787782098.777083:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023798656 00000100:00100000:3.0:1787782098.777135:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787782098.777146:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:15777:x1874625023798656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782098.777172:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782098.777190:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482045400/0x3ad9816c9045526e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455267 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.777216:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482045400/0x3ad9816c9045526e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455267 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.777227:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482045400/0x3ad9816c9045526e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455267 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.777237:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482045400, rc 0) 00000100:00100000:3.0:1787782098.777281:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023798656:12345-0@lo:101:mount.lustre.0 Request processed in 137us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782098.777288:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787782098.778093:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479334f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798656:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782098.778124:0:15777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90455267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045526e expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.778513:0:15777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90455267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045526e expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782098.779835:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787782098.782711:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782098.783496:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787782098.783549:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787782098.783581:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787782098.783704:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787782098.783745:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787782098.783775:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787782098.783886:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787782098.783895:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787782098.784245:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782098.784317:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782098.784367:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef452157c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782098.784516:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023798784 00000100:00100000:0.0:1787782098.784530:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023798784 00000100:00100000:0.0:1787782098.784597:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787782098.784609:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023798784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782098.785572:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023798784:12345-0@lo:501:mount.lustre.0 Request processed in 961us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782098.785584:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787782098.786247:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782098.786296:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479336940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782098.786353:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782098.786432:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4467509c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782098.786487:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023798912 00000100:00100000:1.0:1787782098.786493:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023798912 00000100:00100000:1.0:1787782098.786574:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787782098.786591:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023798912:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782098.786921:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023798912:12345-0@lo:503:mount.lustre.0 Request processed in 332us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782098.786945:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787782098.789716:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479336940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023798912:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787782098.791499:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787782098.791606:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479336940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799040:0@lo:502:mount.lustre.0 00000001:00080000:3.0:1787782098.793016:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787782098.793038:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787782098.793585:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782098.793684:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4467509c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782098.793880:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023799040 00000100:00100000:3.0:1787782098.793891:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023799040 00000100:00100000:1.0:1787782098.794320:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787782098.794333:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023799040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782098.795339:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023799040:12345-0@lo:502:mount.lustre.0 Request processed in 1004us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782098.795350:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787782098.795359:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479336940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782098.796533:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787782098.796639:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787782098.796697:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787782098.797024:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787782098.797067:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787782098.797237:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787782098.797299:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787782098.797353:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787782098.797418:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787782098.797491:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782098.797598:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782098.797655:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f3b13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782098.797765:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023799168 00000100:00100000:1.0:1787782098.797778:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023799168 00000100:00100000:1.0:1787782098.797871:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787782098.797880:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023799168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782098.798876:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023799168:12345-0@lo:502:mount.lustre.0 Request processed in 993us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782098.798887:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787782098.798942:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782098.799086:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787782098.799114:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787782098.801766:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787782098.801782:0:15781:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787782098.801810:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782098.801813:0:15781:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787782098.801821:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787782098.801842:0:15781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ef477d019b8) 00000020:00000080:1.0:1787782098.801874:0:15781:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787782098.801881:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787782098.801957:0:15781:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef479c77800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787782098.801967:0:15781:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787782098.801974:0:15781:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3ad9816c9045527c 00010000:00010000:2.0:1787782098.809028:0:15781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787782098.810564:0:15781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787782098.821099:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787782098.825292:0:15781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787782098.825314:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782098.825323:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.826055:0:15781:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787782098.826069:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782098.826077:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.826079:0:15781:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787782098.826084:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787782098.826087:0:15781:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787782098.826090:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782098.826093:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.826095:0:15781:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787782098.826098:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782098.826101:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.826235:0:15781:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787782098.826258:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787782098.826568:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782098.826573:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.826575:0:15781:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787782098.826579:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787782098.829273:0:15777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787782098.829621:0:15777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787782098.830574:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90455267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045526e expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.830593:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef440031600/0x3ad9816c90455267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045526e expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782098.830603:0:15777:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef479c77800 from 1 10000000:01000000:3.0:1787782098.830607:0:15777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782098.830660:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.830670:0:15777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.830683:0:15777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782098.830725:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787782098.830835:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782098.830897:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782098.831127:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023799296 00000100:00100000:1.0:1787782098.831148:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023799296 00000100:00100000:1.0:1787782098.831234:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787782098.831246:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:15777:x1874625023799296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782098.831262:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782098.831279:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455283 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.831309:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455283 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.831322:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455283 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.831333:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183ec00, rc 0) 00000100:00100000:1.0:1787782098.831631:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799296:12345-0@lo:101:mount.lustre.0 Request processed in 138us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782098.831641:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787782098.832112:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782098.832135:0:15777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.832147:0:15777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782098.833590:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787782098.842395:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782098.843086:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787782098.843284:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787782098.843358:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787782098.843367:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787782098.843647:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782098.843905:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782098.843959:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef476884c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782098.848688:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023799424 00000100:00100000:0.0:1787782098.848705:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023799424 00000100:00100000:0.0:1787782098.848857:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787782098.848869:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782098.849228:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799424:12345-0@lo:501:mount.lustre.0 Request processed in 359us (5321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782098.849238:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787782098.849291:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782098.849398:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782098.849492:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782098.849547:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f48a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782098.850235:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023799552 00000100:00100000:2.0:1787782098.850245:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023799552 00000100:00100000:2.0:1787782098.850305:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787782098.850316:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782098.850816:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799552:12345-0@lo:503:mount.lustre.0 Request processed in 471us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782098.850829:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787782098.850880:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799552:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787782098.851722:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787782098.851810:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479335680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782098.851877:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782098.851915:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef446750000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782098.853710:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023799680 00000100:00100000:2.0:1787782098.853727:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023799680 00000100:00100000:2.0:1787782098.853821:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787782098.853832:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782098.854299:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799680:12345-0@lo:502:mount.lustre.0 Request processed in 468us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782098.854309:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787782098.854894:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479335680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782098.855298:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787782098.855531:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787782098.855594:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787782098.855645:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787782098.855677:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787782098.855960:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787782098.856008:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787782098.856067:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787782098.856125:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782098.856467:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782098.856878:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef476884c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787782098.856970:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023799808 00000100:00100000:2.0:1787782098.856979:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023799808 00000100:00100000:2.0:1787782098.857035:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787782098.857045:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782098.857984:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799808:12345-0@lo:502:mount.lustre.0 Request processed in 935us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782098.857997:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787782098.858100:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782098.858594:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787782098.858615:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787782098.860687:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782098.860705:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.860782:0:15785:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787782098.860836:0:15785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef479c77800 00000020:00000080:2.0:1787782098.860839:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787782098.860850:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782098.860852:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.860854:0:15785:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787782098.860856:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782098.860859:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.860860:0:15785:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787782098.860863:0:15785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ef479c77800 00000020:00000080:2.0:1787782098.860865:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787782098.860939:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782098.860943:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.860944:0:15785:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787782098.860948:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782098.860951:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.860953:0:15785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787782098.860957:0:15785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ef479c77800 00000020:00000080:2.0:1787782098.860959:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787782098.860996:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782098.861000:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782098.861001:0:15785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787782098.861005:0:15785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787782098.861289:0:15777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787782098.861319:0:15777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787782098.861357:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.861370:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782098.861587:0:15777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787782098.861591:0:15777:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ef479c77800 10000000:01000000:1.0:1787782098.861596:0:15777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ef479c77800 10000000:01000000:1.0:1787782098.861601:0:15777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787782098.861608:0:15777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ef479c77800 from 1 10000000:01000000:1.0:1787782098.861611:0:15777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787782098.861657:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c90455291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.861668:0:15777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c90455291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.861696:0:15777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c90455291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782098.861964:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782098.862061:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782098.862130:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4467509c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782098.862345:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023799936 00000100:00100000:3.0:1787782098.862354:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023799936 00000100:00100000:3.0:1787782098.862831:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787782098.862844:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023799936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782098.862862:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782098.862882:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482045000/0x3ad9816c90455298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455291 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.862912:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482045000/0x3ad9816c90455298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455291 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.862925:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482045000/0x3ad9816c90455298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455291 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782098.862935:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482045000, rc 0) 00000100:00100000:3.0:1787782098.863001:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023799936:12345-0@lo:101:mount.lustre.0 Request processed in 160us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782098.863009:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787782098.863566:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023799936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782098.863588:0:15777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c90455291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455298 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.863601:0:15777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c90455291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90455298 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782098.867974:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787782098.869975:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782098.876500:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787782098.876611:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787782098.876651:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787782098.876708:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787782098.876750:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787782098.876866:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787782098.876911:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787782098.876949:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787782098.877007:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787782098.877049:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787782098.877107:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787782098.877178:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787782098.877218:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787782098.877254:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787782098.877320:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787782098.877360:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787782098.877400:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787782098.877454:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787782098.877494:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787782098.877530:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787782098.877583:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787782098.877623:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787782098.877662:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787782098.877717:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787782098.877758:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787782098.877834:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787782098.877910:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787782098.877949:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787782098.877988:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787782098.878041:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787782098.878081:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787782098.878121:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787782098.878174:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787782098.878231:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787782098.878270:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787782098.878324:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787782098.878363:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787782098.878477:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787782098.878486:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787782098.878632:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023800064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782098.878733:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782098.878836:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4467509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782098.878998:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023800064 00000100:00100000:0.0:1787782098.879013:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023800064 00000100:00100000:0.0:1787782098.879096:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787782098.879107:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023800064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782098.879447:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023800064:12345-0@lo:501:mount.lustre.0 Request processed in 341us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782098.879456:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787782098.884372:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023800064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782098.886646:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023800192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782098.886753:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782098.886808:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4467509c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782098.887324:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023800192 00000100:00100000:2.0:1787782098.887333:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023800192 00000100:00100000:2.0:1787782098.888291:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787782098.888308:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023800192:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782098.890739:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023800192:12345-0@lo:503:mount.lustre.0 Request processed in 2425us (3974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782098.890758:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787782098.901331:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023800192:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787782098.903679:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787782098.903845:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023800320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782098.903959:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782098.904020:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef47f3b16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782098.904192:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023800320 00000100:00100000:0.0:1787782098.904227:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023800320 00000100:00100000:0.0:1787782098.904360:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787782098.904373:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023800320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782098.906105:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023800320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782098.906162:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023800320:12345-0@lo:502:mount.lustre.0 Request processed in 1777us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782098.906176:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000040:00080000:0.0:1787782098.908919:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787782098.909015:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787782098.909055:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787782098.909430:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787782098.909477:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787782098.909531:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787782098.909568:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787782098.909603:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787782098.909652:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787782098.909689:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787782098.909724:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787782098.909774:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787782098.909839:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787782098.909874:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787782098.909922:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787782098.911260:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787782098.911734:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787782098.911898:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787782098.912778:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787782098.912869:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787782098.914535:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787782098.915729:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787782098.915831:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787782098.915918:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787782098.915958:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787782098.916029:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787782098.916097:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787782098.916135:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787782098.916187:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787782098.916237:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787782098.916274:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787782098.916309:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787782098.916364:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787782098.916421:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787782098.916456:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787782098.916521:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787782098.916576:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787782098.916620:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787782098.916687:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787782098.916740:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787782098.916882:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023800448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782098.916970:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782098.917024:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445963900 going to sleep for 11 seconds 00000100:00100000:3.0:1787782098.917046:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023800448 00000100:00100000:3.0:1787782098.917065:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023800448 00000100:00100000:0.0:1787782098.919144:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787782098.919178:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef481889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023800448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782098.920496:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef481889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023800448:12345-0@lo:502:mount.lustre.0 Request processed in 1326us (3522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782098.920509:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787782098.921157:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023800448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782098.921387:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787782098.921406:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787782098.928565:0:15790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787782098.928593:0:15790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ef477d04d28) 00000020:00000080:1.0:1787782098.928624:0:15790:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787782098.928748:0:15790:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ef479c77800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787782098.928754:0:15790:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ef479c77800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787782098.928757:0:15790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ef479c77800 3 00010000:00080000:1.0:1787782098.928847:0:15790:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ef45801e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1787782098.931304:0:15790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787782098.931516:0:15790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787782098.931551:0:15790:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787782098.931566:0:15790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3ad9816c904552a6 00000100:00080000:0.0:1787782098.931576:0:15790:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787782098.931581:0:15790:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ef45801e800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1787782098.931626:0:15790:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef4793343c0 x1874625023800576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782098.931647:0:15790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787782098.931713:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874625023800576:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787782098.931879:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782098.931974:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023800576 00000100:00100000:0.0:1787782098.931981:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023800576 00000100:00100000:0.0:1787782098.932032:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782098.932040:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874625023800576:12345-0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787782098.932075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782098.932090:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787782098.932093:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ef47f5b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787782098.932100:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:2.0:1787782098.932118:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787782098.932124:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef47f5b1000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1787782098.932148:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47695c000 x1874625023800832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:0.0:1787782098.932206:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000100:00100000:2.0:1787782098.932249:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023800704:0@lo:400:kworker.0 00000020:00000080:0.0:1787782098.932251:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3ad9816c904552ad 00000004:00100000:0.0:1787782098.932279:0:14377:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787782098.932316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782098.932351:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782098.932363:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023800960:0@lo:400:kworker.0 00000100:00080000:0.0:1787782098.932369:0:14377:0:(import.c:65:import_set_state_nolock()) ffff9ef4515e1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782098.932446:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874625023800576:12345-0@lo:38:llog_process_th.0 Request processed in 406us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782098.932452:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782098.932522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782098.932569:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023801088:0@lo:400:kworker.0 00000100:00100000:2.0:1787782098.932599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782098.932630:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023800960 00000100:00100000:0.0:1787782098.932635:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023800960 00000100:00100000:2.0:1787782098.932663:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023800704 00000100:00100000:0.0:1787782098.932670:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023801088 00000100:00100000:2.0:1787782098.932672:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023800704 00000100:00100000:0.0:1787782098.932675:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023801088 00000100:00100000:0.0:1787782098.932720:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782098.932728:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023800960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782098.932758:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782098.932772:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023800704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782098.932778:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625023800960:12345-0@lo:400:kworker.0 Request processed in 49us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782098.932823:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782098.932836:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782098.932855:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023801088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782098.932888:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023800704:12345-0@lo:400:kworker.0 Request processed in 119us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782098.932898:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782098.932905:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023801088:12345-0@lo:400:kworker.0 Request processed in 51us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782098.932911:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787782098.932934:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782098.932941:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787782098.932991:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef47695e580 x1874625023801088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782098.933008:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023801088:0@lo:400:kworker.0 00010000:00080000:2.0:1787782098.933056:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef47695f0c0 x1874625023800960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782098.933067:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625023800960:0@lo:400:kworker.0 00000100:00100000:2.0:1787782098.933078:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787782098.933103:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023800704:0@lo:400:kworker.0 00000100:00100000:0.0:1787782098.934421:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023800832:0@lo:8:kworker.0 00000100:00100000:0.0:1787782098.934487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787782098.934552:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ef4793343c0 x1874625023800576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782098.934563:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787782098.934572:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787782098.934581:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787782098.934588:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787782098.934591:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef45801e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787782098.934597:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874625023800576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787782098.934784:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023800832 00000100:00100000:2.0:1787782098.934847:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023800832 00000100:00100000:2.0:1787782098.934899:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787782098.934909:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479337c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1874625023800832:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787782098.935004:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479337c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1874625023800832:12345-0@lo:8:kworker.0 Request processed in 96us (516us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787782098.935013:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782098.935063:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787782098.935068:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef47f5b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782098.935071:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787782098.935129:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023800832:0@lo:8:kworker.0 00000040:00080000:1.0:1787782098.936659:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787782098.936757:0:15777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787782098.936836:0:15777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787782098.936852:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c90455291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455298 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782098.936862:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef48183f800/0x3ad9816c90455291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455298 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787782098.937014:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787782098.937017:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787782098.937018:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782098.937020:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782098.937021:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782098.937023:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782098.937024:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787782098.937026:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782098.937028:0:15777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787782098.937032:0:15777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787782098.937034:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787782098.937035:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787782098.937036:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782098.937038:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782098.937038:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782098.937040:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782098.937041:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787782098.937042:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782098.937043:0:15777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787782098.937070:0:15777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787782098.937148:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023801216:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787782098.937231:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782098.937347:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef478db8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782098.937461:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023801216 00000100:00100000:1.0:1787782098.937470:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023801216 00000100:00100000:1.0:1787782098.937527:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787782098.937536:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:15777:x1874625023801216:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787782098.937572:0:14370:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787782098.937588:0:14370:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787782098.970422:0:14370:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787782098.970445:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787782098.970500:0:14394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787782098.970505:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787782098.970527:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.970561:0:14394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455180 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.970570:0:14394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.970610:0:14394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90455180 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.970626:0:14394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90455180 expref: 19 pid: 14370 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782098.970640:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874625023801344:0@lo:104: 00000100:00100000:1.0:1787782098.970708:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782098.970754:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445105600 going to sleep for 11 seconds 00000100:00100000:0.0:1787782098.974836:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023801344 00000100:00100000:0.0:1787782098.974851:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023801344 00000100:00100000:0.0:1787782098.974911:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782098.974921:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:14394:x1874625023801344:12345-0@lo:104: 00010000:00010000:0.0:1787782098.974939:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782098.975031:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787782098.975050:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:14394:x1874625023801344:12345-0@lo:104: Request processed in 131us (4343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782098.975057:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787782098.975252:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782098.975259:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975267:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9600 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787782098.975271:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975280:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782098.975287:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782098.975305:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787782098.975353:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975361:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782098.975382:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975390:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9600/0x3ad9816c90455180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90455187 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975408:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782098.975410:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782098.975412:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782098.975426:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3304:1874625023801472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787782098.975470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782098.975532:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023801472 00000100:00100000:1.0:1787782098.975537:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023801472 00010000:00010000:1.0:1787782098.975563:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90455180 expref: 20 pid: 14370 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782098.975593:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782098.975602:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+20:3304:x1874625023801472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782098.975615:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782098.975620:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90455180 expref: 20 pid: 14370 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975638:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90455180 expref: 20 pid: 14370 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975670:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975680:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787782098.975700:0:14365:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005194972s 00010000:00010000:1.0:1787782098.975705:0:14365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975714:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975721:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975727:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975733:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782098.975737:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975745:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975756:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.975767:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782098.975843:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+20:3304:x1874625023801472:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782098.975857:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782098.975967:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3304:1874625023801472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782098.977398:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef48183f000/0x3ad9816c90455187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90455180 expref: 19 pid: 14370 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782098.977418:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874625023801344:0@lo:104: 00010000:00010000:1.0:1787782098.977439:0:14394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.977448:0:14394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.977455:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782098.977460:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef48183e400/0x3ad9816c904552b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782098.992472:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:15777:x1874625023801216:12345-0@lo:253:mount.lustre.0 Request processed in 54927us (55231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782098.992488:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787782098.992646:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd82860a-d07d-4a23-81c4-f74b9aa945b8:15777:1874625023801216:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787782098.992663:0:15777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787782098.992666:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787782098.992668:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787782098.992669:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782098.992671:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782098.992672:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782098.992673:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782098.992675:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787782098.992676:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782098.992677:0:15777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787782098.992691:0:15777:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787782099.002412:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782099.002636:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787782099.002785:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782099.002966:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787782099.003114:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782099.003331:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787782099.010984:0:15777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1787782099.011121:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787782099.136509:0:15777:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787782099.136519:0:15777:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787782099.136562:0:15777:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787782099.136630:0:15777:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787782099.136645:0:15777:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787782099.136744:0:15777:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1787782099.647308:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023801600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782099.647402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782099.648784:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023801600 00000100:00100000:1.0:1787782099.648824:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023801600 00000100:00100000:1.0:1787782099.648896:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782099.648906:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023801600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782099.648957:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782099.649043:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023801600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782099.649067:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782099.650439:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023801600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787782100.036770:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787782100.926178:0:14375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787782100.926186:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ef4818d0000 from 8 10000000:01000000:0.0:1787782100.926192:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787782100.926245:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440030800/0x3ad9816c904552bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782100.926257:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef440030800/0x3ad9816c904552bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782100.926269:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef440030800/0x3ad9816c904552bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782100.926325:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023801728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782100.926398:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782100.926454:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4622f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782100.926468:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023801728 00000100:00100000:3.0:1787782100.926475:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023801728 00000100:00100000:3.0:1787782100.926530:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787782100.926546:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef48188b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:14375:x1874625023801728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782100.926559:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782100.926573:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482044000/0x3ad9816c904552c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c904552bb expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782100.926595:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482044000/0x3ad9816c904552c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c904552bb expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782100.926606:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482044000/0x3ad9816c904552c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904552bb expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782100.926616:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044000, rc 0) 00000100:00100000:3.0:1787782100.926661:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef48188b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:14375:x1874625023801728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782100.926669:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787782100.927550:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023801728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782100.927566:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef440030800/0x3ad9816c904552bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904552c2 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782100.927576:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef440030800/0x3ad9816c904552bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c904552c2 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782100.927634:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023801856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787782100.927672:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782100.927708:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef4622f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782100.927729:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023801856 00000100:00100000:3.0:1787782100.927734:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023801856 00000100:00100000:3.0:1787782100.927773:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787782100.927781:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:14375:x1874625023801856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787782100.927827:0:14370:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787782100.927846:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787782100.927849:0:14370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787782100.927927:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:14375:x1874625023801856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782100.927934:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787782100.928074:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4793343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023801856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787782100.928256:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787782100.928263:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef440030800/0x3ad9816c904552bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904552c2 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782100.928281:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef440030800/0x3ad9816c904552bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c904552c2 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782101.057877:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782101.503677:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787782102.082740:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782103.102450:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782104.129386:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782104.257559:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782104.257565:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787782104.257570:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ef47f5b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782104.257582:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ef47f5b1000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1787782104.257604:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ef47f3e5680 x1874625023802240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782104.257654:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023802112:0@lo:400:kworker.0 00000100:00100000:1.0:1787782104.257733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782104.257813:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782104.257820:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023802368:0@lo:400:kworker.0 00000100:00100000:1.0:1787782104.257847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782104.257945:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023802496:0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.257976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782104.258005:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787782104.258012:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023801984:0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.258041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782104.258061:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023802624:0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.258081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782104.258117:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023802240:0@lo:8:kworker.0 00000100:00100000:0.0:1787782104.258140:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782104.258170:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023802368 00000100:00100000:0.0:1787782104.258176:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023802368 00000100:00100000:0.0:1787782104.258214:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023802496 00000100:00100000:0.0:1787782104.258217:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023802496 00000100:00100000:0.0:1787782104.258238:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023802624 00000100:00100000:0.0:1787782104.258240:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023802624 00000100:00100000:0.0:1787782104.258255:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782104.258262:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023802368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.258314:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023802368:12345-0@lo:400:kworker.0 Request processed in 51us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.258321:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782104.258337:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782104.258343:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479335680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023802496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.258374:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479335680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023802496:12345-0@lo:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.258379:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782104.258390:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782104.258396:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479336940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023802624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.258420:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479336940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023802624:12345-0@lo:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.258436:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782104.258465:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023802112 00000100:00100000:0.0:1787782104.258469:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023802112 00000100:00100000:0.0:1787782104.258492:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023802240 00000100:00100000:0.0:1787782104.258495:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023802240 00000100:00100000:0.0:1787782104.258504:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782104.258510:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023802112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.258542:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023802112:12345-0@lo:400:kworker.0 Request processed in 32us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.258548:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782104.258558:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782104.258562:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479334f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874625023802240:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787782104.258584:0:15060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1787782104.258612:0:15060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3ad9816c904552c9 00002000:00100000:0.0:1787782104.258625:0:15060:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ef4515e2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787782104.258630:0:15060:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787782104.258633:0:15060:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787782104.258975:0:15060:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787782104.258997:0:15060:0:(import.c:65:import_set_state_nolock()) ffff9ef4515e0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782104.259036:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479334f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874625023802240:12345-0@lo:8:kworker.0 Request processed in 472us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.259043:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787782104.259084:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47f3e4b40 x1874625023802368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782104.259097:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023802368:0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.259135:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023802112:0@lo:400:kworker.0 00010000:00080000:0.0:1787782104.259166:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47f3e5680 x1874625023802240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787782129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787782104.259177:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787782104.259184:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787782104.259189:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787782104.259191:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9ef47f5b1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787782104.259202:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787782104.259206:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874625023802240:0@lo:8:kworker.0 00000004:00080000:0.0:1787782104.259248:0:14403:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787782104.259264:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479337480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14403:1874625023802880:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787782104.259290:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782104.259306:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef479103900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782104.259315:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782104.259323:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479336d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023802752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782104.259347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782104.259373:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023802752 00000100:00100000:0.0:1787782104.259377:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023802752 00000100:00100000:0.0:1787782104.259403:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782104.259410:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023802752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782104.259429:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782104.259464:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479334b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625023802752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.259470:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787782104.259497:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef479336d00 x1874625023802752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782104.259517:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479336d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023802752:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787782104.259547:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47f3e6d00 x1874625023802624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782104.259556:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023802624:0@lo:400:kworker.0 00010000:00080000:0.0:1787782104.259567:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ef47f3e5e00 x1874625023802496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782104.259574:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023802496:0@lo:400:kworker.0 00000100:00100000:0.0:1787782104.259592:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023802880 00000100:00100000:0.0:1787782104.259595:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023802880 00000100:00100000:0.0:1787782104.259611:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782104.259616:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479335e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14403:x1874625023802880:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787782104.261318:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023801984 00000100:00100000:2.0:1787782104.261328:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023801984 00000100:00100000:2.0:1787782104.261376:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787782104.261385:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3305:x1874625023801984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782104.261475:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3305:x1874625023801984:12345-0@lo:400:kworker.0 Request processed in 91us (3433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782104.261482:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787782104.261515:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782104.261519:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782104.261522:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787782104.261536:0:14402:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787782104.270071:0:14402:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 472048278850ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787782104.270166:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023801984:0@lo:400:kworker.0 00002000:00080000:0.0:1787782104.273378:0:15060:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787782104.273391:0:15060:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787782104.273397:0:15060:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1787782104.303197:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.303211:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303231:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.303236:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.303243:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303262:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303282:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303290:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303309:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782104.303322:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.303328:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303336:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.303340:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303350:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303366:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303373:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c904552d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303392:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.303399:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.303401:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.303905:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.303911:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303919:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.303922:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.303927:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303936:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303945:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303952:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303970:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782104.303979:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.303984:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.303991:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.303994:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304014:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304026:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304034:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c904552d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304048:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.304050:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.304051:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.304559:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.304566:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304575:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.304579:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.304583:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304594:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304603:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304617:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304632:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782104.304643:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.304647:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304654:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.304657:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304666:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304678:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304685:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c904552de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.304701:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.304703:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.304705:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.313376:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.313400:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.313421:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.313426:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.313432:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.313448:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.313460:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.313467:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.315945:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782104.315968:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.315976:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.315991:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.315996:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.316008:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.316037:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.316046:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c904552e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.316068:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.316070:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.316072:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.317486:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.317497:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317513:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.317517:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.317524:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317537:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317547:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317555:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317584:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782104.317596:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.317601:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317608:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.317612:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317621:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317636:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317642:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c904552ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.317658:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.317659:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.317661:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.318266:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.318273:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318283:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.318292:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.318298:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318308:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318316:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318324:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318339:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782104.318348:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.318353:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318360:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.318363:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318371:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318382:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318401:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c904552f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.318415:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.318417:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.318418:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.319335:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.319343:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.319353:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.319356:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.319361:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.319371:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.319378:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.319384:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.319396:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.319811:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.319818:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.319828:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.319832:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.319840:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.319869:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.319877:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c904552fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.319896:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.319898:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.319900:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.321252:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.321268:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321284:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.321288:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.321295:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321308:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321318:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321325:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321345:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782104.321358:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.321364:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321372:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.321378:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321388:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321411:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321418:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455301 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.321440:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.321443:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.321447:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.322259:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.322267:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.322278:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.322282:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.322288:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.322299:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.322309:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.322318:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.322355:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.322445:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.322454:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.322465:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.322469:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.322479:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.322493:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.322502:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455308 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.322537:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.322540:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.322542:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.322879:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.322952:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.322961:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.322964:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.322968:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.322978:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.322986:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.322993:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.323007:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782104.323018:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.323023:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.323031:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.323041:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.323049:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.323061:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.323069:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045530f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.323088:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.323089:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.323092:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.324088:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.324098:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324119:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.324124:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.324130:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324141:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324149:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324167:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324183:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782104.324192:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.324198:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324205:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.324208:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324216:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324229:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324236:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f8153b7/0x3ad9816c90455316 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.324249:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.324251:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.324252:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.324722:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.325398:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.325411:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.325416:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.325422:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.325434:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.325444:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.325452:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.325478:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.325494:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.325502:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.325512:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030a00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.325516:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.325524:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.325540:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.325548:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb13e641/0x3ad9816c9045531d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.325567:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.325569:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.325572:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.326117:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.326124:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326133:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.326137:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.326141:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326150:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326166:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326174:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326191:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.326201:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.326209:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.326230:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.326233:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.326241:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.326255:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.326264:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3220bd9/0x3ad9816c90455324 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.326279:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.326282:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.326284:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.326606:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.326613:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326622:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.326626:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.326631:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326642:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326650:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326657:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.326680:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.326969:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.326974:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.326982:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.326985:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.326993:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.327011:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.327020:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c9045532b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.327035:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.327037:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.327038:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.328078:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.328085:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328099:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.328113:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.328119:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328129:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328138:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328146:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328163:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.328246:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.328253:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.328262:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.328267:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.328276:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.328291:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.328299:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c90455332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.328330:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.328332:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.328334:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.328618:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.328625:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328633:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.328643:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.328649:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328659:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328668:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328677:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.328689:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.331273:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.331287:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331302:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441529000 already unused, calling callback (ffffffffc16f5420) 00000004:00080000:0.0:1787782104.331303:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787782104.331309:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331321:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331343:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331352:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee611b90/0x3ad9816c90455339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331373:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.331376:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.331379:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.331447:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.331455:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.331468:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.331473:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.331480:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.331493:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.331503:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.331517:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.331544:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.331566:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.331572:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331593:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441529600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.331597:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331605:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331616:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331623:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4801b39/0x3ad9816c90455340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.331638:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.331640:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.331642:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.332393:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.332401:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.332412:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.332416:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.332421:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.332431:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.332440:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.332448:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.332464:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787782104.333193:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.333201:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333217:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.333220:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.333225:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333234:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333241:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333248:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333269:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787782104.333284:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782104.333289:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333296:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441529200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.333301:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333310:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333338:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333346:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2683324/0x3ad9816c90455347 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333363:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.333366:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333373:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441528200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.333377:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333385:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333396:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333404:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000847b2c6c/0x3ad9816c9045534e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.333417:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.333419:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.333428:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.334088:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.334238:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.334245:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.334256:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.334260:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.334266:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.334277:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.334286:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.334294:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.334318:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.334856:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.334863:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.334873:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441528800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.334878:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.334900:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.334915:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.334921:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c015e345/0x3ad9816c90455355 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.334939:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.334941:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.334943:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.335048:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.335055:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335065:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.335069:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.335074:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335095:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335118:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335127:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335141:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787782104.335518:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.335524:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335534:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.335538:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.335543:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335552:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335561:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335579:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335594:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787782104.335603:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782104.335608:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335615:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef441529c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.335618:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335625:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335635:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335643:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1e931e5/0x3ad9816c9045535c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335656:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782104.335659:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335677:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782104.335680:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335688:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335698:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335705:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa6227d/0x3ad9816c90455363 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.335718:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.335720:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.335721:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.336301:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.336317:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.336324:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.336334:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.336338:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.336344:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.336354:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.336370:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.336377:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.336401:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787782104.336867:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.336874:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.336997:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.337001:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.337006:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.337018:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.337027:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337030:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.337038:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.337040:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337060:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.337065:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337085:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.337088:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.337113:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337135:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044191006/0x3ad9816c9045536a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337153:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.337157:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337164:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.337167:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337175:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337188:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337195:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0f5dafb/0x3ad9816c90455371 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337208:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.337209:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.337210:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.337216:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.337515:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.337523:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.337532:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.337536:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.337540:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.337551:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.337560:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.337568:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.337592:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:3.0:1787782104.337893:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787782104.337967:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.337971:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337982:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.337984:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337990:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.337998:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.338003:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfdd21e4/0x3ad9816c90455378 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.338015:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.338017:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.338019:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787782104.338295:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782104.338301:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338309:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.338318:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782104.338323:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338332:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338339:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338345:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338366:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.338835:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.338841:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.338847:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031000 already unused, calling callback (ffffffffc16f5420) 00002000:00010000:0.0:1787782104.338847:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782104.338852:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338856:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.338859:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338867:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1787782104.338874:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782104.338877:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338879:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.338892:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3fb7cc8/0x3ad9816c9045537f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338900:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.338905:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.338907:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.338910:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782104.338912:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338927:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782104.338947:0:15060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782104.338996:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782104.339000:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.339006:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440030c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782104.339009:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.339015:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.339023:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.339029:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008a57dd0/0x3ad9816c90455386 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782104.339052:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.339054:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782104.339056:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787782104.339153:0:15060:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1787782104.339254:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479335e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14403:x1874625023802880:12345-0@lo:5:osp-pre-1-0.0 Request processed in 79633us (79959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782104.339264:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787782104.339290:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479337480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14403:1874625023802880:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787782104.339308:0:14403:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787782104.339352:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14403:1874625023803008:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787782104.339388:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782104.339427:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef451509540 going to sleep for 11 seconds 00000100:00100000:3.0:1787782104.339463:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023803008 00000100:00100000:3.0:1787782104.339472:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023803008 00000100:00100000:3.0:1787782104.339515:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787782104.339525:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14403:x1874625023803008:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787782104.339559:0:15061:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787782104.347884:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14403:x1874625023803008:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8353us (8487us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787782104.347897:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787782104.348140:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14403:1874625023803008:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787782104.348161:0:14403:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787782104.769320:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782104.769345:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023803136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782104.769417:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782104.769496:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023803136 00000100:00100000:3.0:1787782104.769504:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023803136 00000100:00100000:3.0:1787782104.769553:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782104.769562:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023803136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782104.769599:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782104.769642:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023803136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782104.769649:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782104.769694:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023803136:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782105.150867:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787782105.505819:0:16136:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787782106.175149:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782107.198268:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782107.889601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782107.889692:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005984384 00000100:00100000:3.0:1787782107.889701:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005984384 00000100:00100000:3.0:1787782107.889747:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:3.0:1787782107.889756:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2348:x1874625005984384:12345-192.168.202.56@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787782107.889807:0:14373:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 03474bc7-848a-4d95-ae7f-d483d1ea7417@192.168.202.56@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:3.0:1787782107.889838:0:14373:0:(genops.c:1385:class_connect()) connect: client 03474bc7-848a-4d95-ae7f-d483d1ea7417, cookie 0x3ad9816c9045538d 00000100:00080000:3.0:1787782107.890002:0:14373:0:(import.c:65:import_set_state_nolock()) ffff9ef479c72800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782107.890208:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+5:2348:x1874625005984384:12345-192.168.202.56@tcp:250:mount.lustre.0 Request processed in 450us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782107.890217:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:0.0:1787782107.900988:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782107.901138:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005984512 00000100:00100000:2.0:1787782107.901148:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005984512 00000100:00100000:2.0:1787782107.901207:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:2.0:1787782107.901218:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+5:13754:x1874625005984512:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787782107.901236:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782107.901253:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b9400/0x3ad9816c90455394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dcb7 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782107.901283:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b9400/0x3ad9816c90455394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcb7 expref: 6 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782107.901295:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b9400/0x3ad9816c90455394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcb7 expref: 6 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782107.901304:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9400, rc 0) 00000100:00100000:2.0:1787782107.901366:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+6:13754:x1874625005984512:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 150us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782107.901374:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:2.0:1787782107.908190:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782107.908294:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005984640 00000100:00100000:3.0:1787782107.908305:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005984640 00000100:00100000:3.0:1787782107.908355:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:3.0:1787782107.908364:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+6:13754:x1874625005984640:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787782107.908845:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+6:13754:x1874625005984640:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 479us (662us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787782107.908853:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:3.0:1787782107.913238:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782107.913343:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005984768 00000100:00100000:0.0:1787782107.913353:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005984768 00000100:00100000:0.0:1787782107.913443:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:0.0:1787782107.913464:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+6:13754:x1874625005984768:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787782107.913481:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782107.913511:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440031000/0x3ad9816c9045539b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dcbe expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782107.913539:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440031000/0x3ad9816c9045539b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcbe expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782107.913550:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440031000/0x3ad9816c9045539b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcbe expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782107.913576:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031000, rc 0) 00000100:00100000:0.0:1787782107.913638:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+7:13754:x1874625005984768:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 176us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782107.913646:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:0.0:1787782107.935995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782107.936108:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005984896 00000100:00100000:2.0:1787782107.936119:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005984896 00000100:00100000:2.0:1787782107.936174:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:2.0:1787782107.936184:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+7:13754:x1874625005984896:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787782107.936484:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+8:13754:x1874625005984896:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 301us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782107.936505:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:2.0:1787782107.943625:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782107.943728:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005985024 00000100:00100000:0.0:1787782107.943737:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005985024 00000100:00100000:0.0:1787782107.943838:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:0.0:1787782107.943847:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+8:13754:x1874625005985024:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787782107.944341:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+8:13754:x1874625005985024:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 492us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782107.944350:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:0.0:1787782107.961512:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782107.962043:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005985152 00000100:00100000:3.0:1787782107.962056:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005985152 00000100:00100000:3.0:1787782107.962144:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:3.0:1787782107.962157:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+8:13772:x1874625005985152:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787782107.962548:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+8:13772:x1874625005985152:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 392us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782107.962557:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:0.0:1787782108.004927:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782108.005205:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005985280 00000100:00100000:1.0:1787782108.005219:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005985280 00000100:00100000:1.0:1787782108.005290:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:1.0:1787782108.005302:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+8:13772:x1874625005985280:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787782108.005695:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+8:13772:x1874625005985280:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 394us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782108.005704:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:0.0:1787782108.009705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782108.009830:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005985408 00000100:00100000:2.0:1787782108.009844:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005985408 00000100:00100000:2.0:1787782108.009916:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:2.0:1787782108.009928:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+8:13754:x1874625005985408:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787782108.009951:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782108.009975:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8000/0x3ad9816c904553a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dce8 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782108.010012:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8000/0x3ad9816c904553a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dce8 expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782108.010214:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8000/0x3ad9816c904553a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dce8 expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782108.010227:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8000, rc 0) 00000100:00100000:2.0:1787782108.010303:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+9:13754:x1874625005985408:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 378us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782108.010312:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:0.0:1787782108.020186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782108.020449:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005985536 00000100:00100000:3.0:1787782108.020464:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005985536 00000100:00100000:3.0:1787782108.020599:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:3.0:1787782108.020612:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+9:13754:x1874625005985536:12345-192.168.202.56@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787782108.020649:0:14373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787782108.020689:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787782108.020694:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787782108.020704:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787782108.020707:0:14373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787782108.026218:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+9:13754:x1874625005985536:12345-192.168.202.56@tcp:256:mount.lustre.0 Request processed in 5591us (6030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782108.026240:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:0.0:1787782108.031235:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782108.031337:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005985664 00000100:00100000:2.0:1787782108.031350:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005985664 00000100:00100000:2.0:1787782108.031479:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:2.0:1787782108.031493:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+9:13754:x1874625005985664:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787782108.031517:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782108.031555:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dcef expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782108.031594:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcef expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782108.031608:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcef expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782108.031620:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8a00, rc 0) 00000100:00100000:2.0:1787782108.031702:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13754:x1874625005985664:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 212us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782108.031711:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:0.0:1787782108.036168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782108.036277:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005985792 00000100:00100000:3.0:1787782108.036290:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005985792 00000100:00100000:3.0:1787782108.036363:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:3.0:1787782108.036375:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13754:x1874625005985792:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787782108.036833:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13754:x1874625005985792:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 458us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782108.036841:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:0.0:1787782108.039312:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782108.039420:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005985920 00000100:00100000:2.0:1787782108.039433:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005985920 00000100:00100000:2.0:1787782108.039505:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:2.0:1787782108.039516:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13754:x1874625005985920:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787782108.039900:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13754:x1874625005985920:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 385us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782108.039909:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:0.0:1787782108.047834:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782108.048361:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005986048 00000100:00100000:1.0:1787782108.048377:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005986048 00000100:00100000:1.0:1787782108.048453:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:1.0:1787782108.048466:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef476c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13774:x1874625005986048:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787782108.048856:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef476c53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13774:x1874625005986048:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 392us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782108.048865:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:0.0:1787782108.063236:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782108.069149:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005986176 00000100:00100000:3.0:1787782108.069171:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005986176 00000100:00100000:3.0:1787782108.069263:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:3.0:1787782108.069275:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a58b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13774:x1874625005986176:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787782108.070226:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a58b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13774:x1874625005986176:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 945us (6999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782108.070240:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:0.0:1787782108.083368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782108.083491:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005986304 00000100:00100000:2.0:1787782108.083503:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005986304 00000100:00100000:2.0:1787782108.083563:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1787782108.083594:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479336d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1874625005986304:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787782108.083637:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f79631f7-3d35-46c8-af7e-18b9151ff291@192.168.202.56@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:2.0:1787782108.083707:0:14379:0:(genops.c:1385:class_connect()) connect: client f79631f7-3d35-46c8-af7e-18b9151ff291, cookie 0x3ad9816c904553b0 00000004:00100000:2.0:1787782108.083754:0:14379:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787782108.083762:0:14379:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787782108.174576:0:14379:0:(import.c:65:import_set_state_nolock()) ffff9ef479c77000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782108.174699:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479336d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2348:x1874625005986304:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 91105us (91346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782108.174713:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1787782108.187227:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782108.187278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782108.187408:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005986560 00000100:00100000:0.0:1787782108.187421:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005986560 00000100:00100000:3.0:1787782108.187442:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005986432 00000100:00100000:3.0:1787782108.187448:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005986432 00000100:00100000:3.0:1787782108.187503:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:3.0:1787782108.187516:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+7:0:x1874625005986432:12345-192.168.202.56@tcp:41:mount.lustre.0 00000100:00080000:1.0:1787782108.187653:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1787782108.187722:0:15085:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787782108.187878:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+7:0:x1874625005986432:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 364us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782108.187887:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1787782108.193115:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1787782108.193151:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+7:13754:x1874625005986560:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787782108.193196:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787782108.193302:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+7:13754:x1874625005986560:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 172us (6090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782108.193311:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:0.0:1787782108.197952:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782108.198030:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005986688 00000100:00100000:3.0:1787782108.198044:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005986688 00000100:00100000:3.0:1787782108.198129:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1787782108.198142:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479336580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:13754:x1874625005986688:12345-192.168.202.56@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787782108.198256:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479336580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:13754:x1874625005986688:12345-192.168.202.56@tcp:40:mount.lustre.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782108.198264:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1787782108.201846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782108.201890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782108.202157:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005987072 00000100:00100000:3.0:1787782108.202171:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005987072 00000100:00100000:2.0:1787782108.202204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782108.202241:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:3.0:1787782108.202253:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:13754:x1874625005987072:12345-192.168.202.56@tcp:33:mount.lustre.0 00000100:00100000:0.0:1787782108.202293:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005986816 00000100:00100000:0.0:1787782108.202298:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005986816 00000100:00100000:0.0:1787782108.202329:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005986944 00000100:00100000:0.0:1787782108.202332:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005986944 00000100:00100000:0.0:1787782108.202365:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:0.0:1787782108.202370:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1874625005986816:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787782108.202401:0:15060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f79631f7-3d35-46c8-af7e-18b9151ff291@192.168.202.56@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1787782108.202438:0:15060:0:(genops.c:1385:class_connect()) connect: client f79631f7-3d35-46c8-af7e-18b9151ff291, cookie 0x3ad9816c904553b7 00002000:00100000:0.0:1787782108.202454:0:15060:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f79631f7-3d35-46c8-af7e-18b9151ff291/ffff9ef4515e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787782108.202485:0:15060:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787782108.203358:0:15060:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787782108.203402:0:15060:0:(import.c:65:import_set_state_nolock()) ffff9ef4515e2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782108.203542:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2348:x1874625005986816:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 1168us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782108.203552:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:0.0:1787782108.203581:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:0.0:1787782108.203587:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1874625005986944:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787782108.203609:0:15060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f79631f7-3d35-46c8-af7e-18b9151ff291@192.168.202.56@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1787782108.203632:0:15060:0:(genops.c:1385:class_connect()) connect: client f79631f7-3d35-46c8-af7e-18b9151ff291, cookie 0x3ad9816c904553be 00002000:00100000:0.0:1787782108.203641:0:15060:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f79631f7-3d35-46c8-af7e-18b9151ff291/ffff9ef4515e1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787782108.203662:0:15060:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787782108.203874:0:15060:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787782108.203892:0:15060:0:(import.c:65:import_set_state_nolock()) ffff9ef4515e5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782108.203932:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2348:x1874625005986944:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 342us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782108.203938:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000004:00080000:0.0:1787782108.204638:0:14380:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2293us 00010000:00010000:3.0:1787782108.222618:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:2.0:1787782108.224684:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787782108.225182:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:13754:x1874625005987072:12345-192.168.202.56@tcp:33:mount.lustre.0 Request processed in 22922us (23383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782108.225205:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1787782108.434150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782108.434365:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005987200 00000100:00100000:3.0:1787782108.434377:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005987200 00000100:00100000:3.0:1787782108.434499:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:3.0:1787782108.434510:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+6:13795:x1874625005987200:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:3.0:1787782108.434544:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782108.434574:0:15085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044200/0x3ad9816c904553c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd19 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782108.434654:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045c00/0x3ad9816c904553cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782108.434685:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045c00/0x3ad9816c904553cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782108.434698:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045c00/0x3ad9816c904553cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782108.434993:0:15085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787782108.434998:0:15085:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782108.435137:0:15085:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045c00/0x3ad9816c904553cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782108.435174:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044200/0x3ad9816c904553c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd19 expref: 8 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782108.435196:0:15085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045c00/0x3ad9816c904553cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd19 expref: 7 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782108.435206:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45497c100) 00010000:00010000:3.0:1787782108.435209:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782108.435212:0:15085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482045c00, rc 0) 00000100:00100000:3.0:1787782108.435677:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+7:13795:x1874625005987200:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 1166us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782108.435688:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000001:00100000:3.0:1787782108.969648:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f79631f7-3d35-46c8-af7e-18b9151ff291 00010000:00010000:3.0:1787782109.248719:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782109.374355:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782109.374455:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782109.374526:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023803392:0@lo:400:kworker.0 00000100:00100000:0.0:1787782109.374627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782109.374775:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023803392 00000100:00100000:0.0:1787782109.374784:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023803392 00000100:00100000:0.0:1787782109.374875:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782109.374886:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023803392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782109.374961:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023803392:12345-0@lo:400:kworker.0 Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782109.374969:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782109.375019:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023803392:0@lo:400:kworker.0 00000100:00080000:0.0:1787782109.375069:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782109.375092:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4793361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023803520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782109.375144:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782109.375187:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023803520 00000100:00100000:0.0:1787782109.375191:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023803520 00000100:00100000:0.0:1787782109.375226:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782109.375234:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4793343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625023803520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782109.375272:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782109.375309:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4793343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625023803520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782109.375316:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787782109.375332:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782109.375353:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4793361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023803520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782109.383332:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3306:1874625023803264:0@lo:400:kworker.0 00000100:00100000:1.0:1787782109.383441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782109.383499:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023803264 00000100:00100000:1.0:1787782109.383509:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023803264 00000100:00100000:1.0:1787782109.383699:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787782109.383710:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3306:x1874625023803264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782109.383775:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3306:x1874625023803264:12345-0@lo:400:kworker.0 Request processed in 66us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782109.383783:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787782109.383876:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3306:1874625023803264:0@lo:400:kworker.0 00000100:00100000:3.0:1787782109.385716:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023803648:0@lo:400:kworker.0 00000100:00100000:3.0:1787782109.385818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782109.385892:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023803648 00000100:00100000:3.0:1787782109.385924:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023803648 00000100:00100000:3.0:1787782109.385984:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787782109.385994:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023803648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782109.386051:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023803648:12345-0@lo:400:kworker.0 Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782109.386071:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787782109.386135:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023803648:0@lo:400:kworker.0 00000100:00100000:3.0:1787782109.386380:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023803776:0@lo:400:kworker.0 00000100:00100000:3.0:1787782109.386411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782109.386443:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023803776 00000100:00100000:3.0:1787782109.386447:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023803776 00000100:00100000:3.0:1787782109.386483:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787782109.386491:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023803776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782109.386988:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023803776:12345-0@lo:400:kworker.0 Request processed in 496us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782109.386997:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787782109.387019:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782109.388020:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023803776:0@lo:400:kworker.0 00000100:00100000:3.0:1787782109.388304:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782109.388315:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023803904:0@lo:400:kworker.0 00000100:00100000:3.0:1787782109.388373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782109.388409:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023803904 00000100:00100000:3.0:1787782109.388414:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023803904 00000100:00100000:3.0:1787782109.388459:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787782109.388467:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023803904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782109.388879:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023803904:12345-0@lo:400:kworker.0 Request processed in 412us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782109.388907:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787782109.388928:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782109.388954:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023803904:0@lo:400:kworker.0 00000001:00100000:1.0:1787782109.483444:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f79631f7-3d35-46c8-af7e-18b9151ff291 00000001:00080000:1.0:1787782109.483508:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1787782109.887597:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023804032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782109.887708:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782109.891491:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023804032 00000100:00100000:3.0:1787782109.891513:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023804032 00000100:00100000:3.0:1787782109.891619:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787782109.891632:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4793361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023804032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782109.891691:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782109.891869:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4793361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023804032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 239us (4161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782109.891878:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782109.892125:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023804032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782110.270118:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782110.615147:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782110.615360:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005987328 00000100:00100000:3.0:1787782110.615375:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005987328 00000100:00100000:3.0:1787782110.615494:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1787782110.615507:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+7:13847:x1874625005987328:12345-192.168.202.56@tcp:41:lfs.0 00000004:00000024:3.0:1787782110.615588:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787782110.615711:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+7:13847:x1874625005987328:12345-192.168.202.56@tcp:41:lfs.0 Request processed in 206us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782110.615721:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00080000:0.0:1787782110.615997:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782110.626174:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782110.626496:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005987456 00000100:00100000:0.0:1787782110.626511:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005987456 00000100:00100000:0.0:1787782110.626642:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:0.0:1787782110.626654:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f79631f7-3d35-46c8-af7e-18b9151ff291+5:13847:x1874625005987456:12345-192.168.202.56@tcp:13:lfs.0 00002000:00000024:0.0:1787782110.626688:0:15063:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782110.627246:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f79631f7-3d35-46c8-af7e-18b9151ff291+5:13847:x1874625005987456:12345-192.168.202.56@tcp:13:lfs.0 Request processed in 591us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782110.627256:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00080000:3.0:1787782110.627690:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782110.632511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782110.632646:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005987584 00000100:00100000:1.0:1787782110.632660:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005987584 00000100:00100000:1.0:1787782110.632749:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:1.0:1787782110.632761:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f79631f7-3d35-46c8-af7e-18b9151ff291+5:13847:x1874625005987584:12345-192.168.202.56@tcp:13:lfs.0 00002000:00000024:1.0:1787782110.632839:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782110.633156:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f79631f7-3d35-46c8-af7e-18b9151ff291+5:13847:x1874625005987584:12345-192.168.202.56@tcp:13:lfs.0 Request processed in 395us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782110.633191:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00080000:3.0:1787782110.633876:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782110.983340:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782110.983491:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005987712 00000100:00100000:3.0:1787782110.983505:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005987712 00000100:00100000:3.0:1787782110.983581:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 90 00000100:00100000:3.0:1787782110.983594:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+10:13877:x1874625005987712:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787782110.983628:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782110.983651:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482044200/0x3ad9816c904553d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd20 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782110.983690:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482044200/0x3ad9816c904553d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd20 expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782110.983704:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482044200/0x3ad9816c904553d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd20 expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782110.983716:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044200, rc 0) 00000100:00100000:3.0:1787782110.983862:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13877:x1874625005987712:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 270us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782110.983871:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 90 00000100:00100000:2.0:1787782111.004456:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782111.004571:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005987840 00000100:00100000:1.0:1787782111.004584:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005987840 00000100:00100000:1.0:1787782111.004651:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:1.0:1787782111.004663:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13877:x1874625005987840:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787782111.005381:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13877:x1874625005987840:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 716us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782111.005393:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:0.0:1787782111.018331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782111.018433:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005987968 00000100:00100000:1.0:1787782111.018446:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005987968 00000100:00100000:1.0:1787782111.018516:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00100000:1.0:1787782111.018528:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13877:x1874625005987968:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787782111.019363:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13877:x1874625005987968:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 834us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782111.019374:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00100000:2.0:1787782111.047859:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782111.048062:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005988096 00000100:00100000:3.0:1787782111.048076:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005988096 00000100:00100000:3.0:1787782111.048164:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 93 00000100:00100000:3.0:1787782111.048177:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13886:x1874625005988096:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787782111.048642:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452615450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13886:x1874625005988096:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 466us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782111.048653:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 93 00000100:00100000:0.0:1787782111.085682:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782111.085848:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005988224 00000100:00100000:2.0:1787782111.085862:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005988224 00000100:00100000:2.0:1787782111.086201:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 94 00000100:00100000:2.0:1787782111.086214:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13886:x1874625005988224:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787782111.086575:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13886:x1874625005988224:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 362us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782111.086585:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 94 00000100:00100000:0.0:1787782111.094271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782111.094529:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005988352 00000100:00100000:1.0:1787782111.094543:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005988352 00000100:00100000:1.0:1787782111.094621:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00100000:1.0:1787782111.094634:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13877:x1874625005988352:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787782111.094660:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782111.094686:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef48183f000/0x3ad9816c904553da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd4a expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782111.094727:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef48183f000/0x3ad9816c904553da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd4a expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782111.094767:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef48183f000/0x3ad9816c904553da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd4a expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782111.094778:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f000, rc 0) 00000100:00100000:1.0:1787782111.095313:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452614450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13877:x1874625005988352:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 334us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782111.095326:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00100000:0.0:1787782111.102437:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782111.104410:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005988480 00000100:00100000:2.0:1787782111.104428:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005988480 00000100:00100000:2.0:1787782111.104509:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 96 00000100:00100000:2.0:1787782111.104519:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13877:x1874625005988480:12345-192.168.202.56@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787782111.104554:0:14372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787782111.104584:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787782111.104589:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787782111.104593:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787782111.104596:0:14372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787782111.107362:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13877:x1874625005988480:12345-192.168.202.56@tcp:256:mount.lustre.0 Request processed in 2825us (4923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782111.107381:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 96 00000100:00100000:0.0:1787782111.110898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782111.111150:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005988608 00000100:00100000:3.0:1787782111.111165:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005988608 00000100:00100000:3.0:1787782111.111244:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:3.0:1787782111.111257:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13877:x1874625005988608:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787782111.111281:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782111.111325:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd51 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782111.111364:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd51 expref: 13 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782111.111377:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd51 expref: 13 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782111.111389:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044a00, rc 0) 00000100:00100000:3.0:1787782111.111461:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13877:x1874625005988608:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 207us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782111.111470:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:0.0:1787782111.114447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782111.114554:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005988736 00000100:00100000:2.0:1787782111.114567:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005988736 00000100:00100000:2.0:1787782111.114629:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00100000:2.0:1787782111.114639:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef452617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13877:x1874625005988736:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787782111.115335:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef452617c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13877:x1874625005988736:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 693us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782111.115354:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00100000:0.0:1787782111.118573:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782111.118668:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005988864 00000100:00100000:1.0:1787782111.118681:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005988864 00000100:00100000:1.0:1787782111.118751:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 99 00000100:00100000:1.0:1787782111.118762:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13877:x1874625005988864:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787782111.119408:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13877:x1874625005988864:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 644us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782111.119418:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 99 00000100:00100000:0.0:1787782111.122721:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782111.123487:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005988992 00000100:00100000:3.0:1787782111.123552:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005988992 00000100:00100000:3.0:1787782111.123634:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 100 00000100:00100000:3.0:1787782111.123648:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13889:x1874625005988992:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787782111.124563:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13889:x1874625005988992:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 913us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782111.124576:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 100 00000100:00100000:0.0:1787782111.129119:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782111.129212:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005989120 00000100:00100000:2.0:1787782111.129225:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005989120 00000100:00100000:2.0:1787782111.129293:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 101 00000100:00100000:2.0:1787782111.129305:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13889:x1874625005989120:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787782111.129612:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13889:x1874625005989120:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 308us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782111.129621:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 101 00000100:00100000:0.0:1787782111.136653:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782111.136959:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005989248 00000100:00100000:3.0:1787782111.136989:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005989248 00000100:00100000:3.0:1787782111.137060:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1787782111.137072:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479335a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1874625005989248:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787782111.137124:0:14378:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dcb5214e-4f9e-44fb-a0ba-a56fa13450fe@192.168.202.56@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1787782111.137175:0:14378:0:(genops.c:1385:class_connect()) connect: client dcb5214e-4f9e-44fb-a0ba-a56fa13450fe, cookie 0x3ad9816c904553e8 00000004:00100000:3.0:1787782111.137221:0:14378:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787782111.137401:0:14378:0:(import.c:65:import_set_state_nolock()) ffff9ef477d54800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782111.137500:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479335a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2348:x1874625005989248:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 428us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782111.137508:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:0.0:1787782111.154874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782111.154921:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782111.155028:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005989376 00000100:00100000:1.0:1787782111.155072:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005989376 00000100:00100000:1.0:1787782111.155179:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005989504 00000100:00100000:1.0:1787782111.155183:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005989504 00000100:00100000:1.0:1787782111.155208:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:1.0:1787782111.155219:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+7:0:x1874625005989376:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787782111.155263:0:15085:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787782111.155360:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+7:0:x1874625005989376:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 142us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782111.155369:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:1.0:1787782111.155391:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:1.0:1787782111.155419:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:13877:x1874625005989504:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787782111.155431:0:15085:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787782111.155453:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b41e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:13877:x1874625005989504:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 35us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782111.155460:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00080000:0.0:1787782111.155644:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782111.160567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782111.160688:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005989632 00000100:00100000:1.0:1787782111.160702:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005989632 00000100:00100000:1.0:1787782111.160781:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:1.0:1787782111.160841:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:13877:x1874625005989632:12345-192.168.202.56@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787782111.161285:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:13877:x1874625005989632:12345-192.168.202.56@tcp:40:mount.lustre.0 Request processed in 492us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782111.161295:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1787782111.165145:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782111.165197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782111.165242:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782111.165527:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005989760 00000100:00100000:2.0:1787782111.165541:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005989760 00000100:00100000:1.0:1787782111.165548:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005990016 00000100:00100000:1.0:1787782111.165555:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005990016 00000100:00100000:2.0:1787782111.165593:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005989888 00000100:00100000:2.0:1787782111.165598:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005989888 00000100:00100000:1.0:1787782111.165609:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:2.0:1787782111.165617:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1787782111.165624:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:13877:x1874625005990016:12345-192.168.202.56@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787782111.165626:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1874625005989760:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787782111.165669:0:15060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dcb5214e-4f9e-44fb-a0ba-a56fa13450fe@192.168.202.56@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1787782111.165713:0:15060:0:(genops.c:1385:class_connect()) connect: client dcb5214e-4f9e-44fb-a0ba-a56fa13450fe, cookie 0x3ad9816c904553ef 00002000:00100000:2.0:1787782111.165728:0:15060:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dcb5214e-4f9e-44fb-a0ba-a56fa13450fe/ffff9ef47b2cc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787782111.165742:0:15060:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:1.0:1787782111.166079:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787782111.166259:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:13877:x1874625005990016:12345-192.168.202.56@tcp:33:mount.lustre.0 Request processed in 636us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782111.166270:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00002000:00080000:2.0:1787782111.166299:0:15060:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787782111.166338:0:15060:0:(import.c:65:import_set_state_nolock()) ffff9ef47b2c8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782111.166370:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2348:x1874625005989760:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 745us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782111.166378:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1787782111.166398:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:2.0:1787782111.166412:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1874625005989888:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787782111.166430:0:15060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dcb5214e-4f9e-44fb-a0ba-a56fa13450fe@192.168.202.56@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1787782111.166451:0:15060:0:(genops.c:1385:class_connect()) connect: client dcb5214e-4f9e-44fb-a0ba-a56fa13450fe, cookie 0x3ad9816c904553f6 00002000:00100000:2.0:1787782111.166458:0:15060:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dcb5214e-4f9e-44fb-a0ba-a56fa13450fe/ffff9ef47b2cf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787782111.166465:0:15060:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787782111.166605:0:15060:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787782111.166621:0:15060:0:(import.c:65:import_set_state_nolock()) ffff9ef47b2ce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782111.166645:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2348:x1874625005989888:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 232us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782111.166653:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00010000:00010000:3.0:1787782111.294541:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782111.412543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782111.417322:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005990144 00000100:00100000:3.0:1787782111.417343:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005990144 00000100:00100000:3.0:1787782111.417445:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:3.0:1787782111.417458:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:13910:x1874625005990144:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:3.0:1787782111.417488:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782111.417515:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045600/0x3ad9816c904553fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd7b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782111.418574:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782111.418598:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782111.418612:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782111.420652:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787782111.420664:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782111.421355:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782111.421416:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045600/0x3ad9816c904553fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd7b expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782111.421460:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd7b expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782111.421470:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45497c100) 00010000:00010000:3.0:1787782111.421474:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782111.421479:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044800, rc 0) 00000100:00100000:3.0:1787782111.421587:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+7:13910:x1874625005990144:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 4130us (9061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782111.421598:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000040:00080000:3.0:1787782111.743199:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787782112.320640:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782113.342223:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787782113.521563:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dcb5214e-4f9e-44fb-a0ba-a56fa13450fe 00000001:00100000:1.0:1787782113.521578:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f79631f7-3d35-46c8-af7e-18b9151ff291 00000001:00100000:3.0:1787782114.008515:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dcb5214e-4f9e-44fb-a0ba-a56fa13450fe 00010000:00010000:3.0:1787782114.366287:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782114.499317:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023804160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782114.499396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782114.499483:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023804160 00000100:00100000:3.0:1787782114.499490:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023804160 00000100:00100000:3.0:1787782114.499548:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787782114.499558:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023804160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782114.499594:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782114.499642:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625023804160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782114.499650:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787782114.499672:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787782114.499713:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787782114.499734:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874625023804160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782114.502003:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023804288:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782114.502131:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023804800:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782114.502185:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782114.502192:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023804416:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782114.502250:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023804800 00000100:00100000:3.0:1787782114.502258:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023804800 00000100:00100000:3.0:1787782114.502314:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787782114.502324:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023804800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502370:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023804800:12345-0@lo:400:kworker.0 Request processed in 48us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782114.502378:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787782114.502401:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023804416 00000100:00100000:3.0:1787782114.502405:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023804416 00000100:00100000:3.0:1787782114.502433:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782114.502440:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023804416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502470:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023804416:12345-0@lo:400:kworker.0 Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782114.502476:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782114.502501:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023804544:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502525:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782114.502545:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782114.502566:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023804672:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502591:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782114.502614:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023804544 00000100:00100000:3.0:1787782114.502618:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023804544 00000100:00100000:3.0:1787782114.502639:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023804672 00000100:00100000:3.0:1787782114.502642:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023804672 00000100:00100000:3.0:1787782114.502660:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787782114.502665:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023804544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502698:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625023804544:12345-0@lo:400:kworker.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782114.502705:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787782114.502719:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787782114.502726:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef460d60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023804672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502750:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef460d60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625023804672:12345-0@lo:400:kworker.0 Request processed in 25us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782114.502756:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787782114.502776:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782114.502781:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782114.502823:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625023804672:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502834:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625023804544:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502886:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023804416:0@lo:400:kworker.0 00000100:00100000:3.0:1787782114.502895:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023804800:0@lo:400:kworker.0 00000100:00100000:1.0:1787782114.504329:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023804288 00000100:00100000:1.0:1787782114.504339:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023804288 00000100:00100000:1.0:1787782114.504395:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787782114.504403:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3305:x1874625023804288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782114.504485:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478958850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3305:x1874625023804288:12345-0@lo:400:kworker.0 Request processed in 82us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782114.504493:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787782114.505181:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023804288:0@lo:400:kworker.0 00000001:00100000:1.0:1787782114.626375:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dcb5214e-4f9e-44fb-a0ba-a56fa13450fe 00000001:02000400:0.0:1787782114.662241:0:16345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787782115.007669:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782115.007687:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023804928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782115.007750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782115.007829:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023804928 00000100:00100000:3.0:1787782115.007834:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023804928 00000100:00100000:3.0:1787782115.007876:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787782115.007885:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023804928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782115.007918:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782115.007954:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023804928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782115.007971:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787782115.008041:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023804928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782115.390734:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782116.298942:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782116.298985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782116.299023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782116.299051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782116.299081:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782116.299108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782116.299163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782116.299200:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005990656 00000100:00100000:2.0:1787782116.299211:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005990656 00000100:00100000:2.0:1787782116.299284:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005990912 00000100:00100000:2.0:1787782116.299288:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005990912 00000100:00100000:2.0:1787782116.299305:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005990528 00000100:00100000:2.0:1787782116.299308:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005990528 00000100:00080000:1.0:1787782116.299315:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782116.299328:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005991040 00000100:00080000:1.0:1787782116.299329:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782116.299336:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005991040 00000100:00100000:2.0:1787782116.299369:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1787782116.299378:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2350:x1874625005990656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:1.0:1787782116.299410:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782116.299472:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2350:x1874625005990656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 93us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782116.299481:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1787782116.299498:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1787782116.299505:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2350:x1874625005990912:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782116.299529:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2350:x1874625005990912:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782116.299535:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1787782116.299546:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1787782116.299552:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2350:x1874625005990528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782116.299579:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2350:x1874625005990528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782116.299585:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1787782116.299596:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1787782116.299603:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2350:x1874625005991040:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787782116.300088:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005990400 00000100:00100000:0.0:1787782116.300093:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005990400 00000100:00100000:0.0:1787782116.300166:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005990784 00000100:00100000:0.0:1787782116.300177:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005990784 00000100:00100000:2.0:1787782116.300193:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2350:x1874625005991040:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 589us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782116.300200:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1787782116.300203:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:0.0:1787782116.300209:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2350:x1874625005990400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787782116.300242:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2350:x1874625005990400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782116.300249:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:0.0:1787782116.300262:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:0.0:1787782116.300268:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2350:x1874625005990784:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782116.300285:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005990272 00000100:00100000:2.0:1787782116.300289:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005990272 00000100:00100000:0.0:1787782116.300291:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2350:x1874625005990784:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782116.300297:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1787782116.300313:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00100000:2.0:1787782116.300319:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:2350:x1874625005990272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782116.300345:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478958c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:2350:x1874625005990272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782116.300360:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00080000:0.0:1787782116.300852:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787782116.426614:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782117.440703:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782118.468948:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787782118.599533:0:16492:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde0169020 20000000:00000080:1.0:1787782118.599561:0:16492:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ef3420b0c00 uarg=0000000000000000 20000000:01000000:1.0:1787782118.599613:0:16492:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787782118.599621:0:16492:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787782118.599627:0:16492:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787782118.602547:0:16493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787782118.602895:0:16492:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787782118.618248:0:16492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787782118.618294:0:16492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.618322:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c904550fb expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.618333:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455148 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.619480:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455283 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.619498:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcef expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.619533:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd51 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.619543:0:16492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.619598:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd51 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.619617:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd51 expref: 12 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.619636:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805056:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787782118.619768:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcef expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.619777:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcef expref: 12 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.619785:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805184:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787782118.619902:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90455283 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.619911:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90455283 expref: 18 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.619920:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805312:0@lo:104: 00000100:00100000:3.0:1787782118.620354:0:16492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787782118.620415:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c90455148 expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.620423:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c90455148 expref: 18 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.620431:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805440:0@lo:104: 00000100:00100000:3.0:1787782118.620453:0:16492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787782118.620485:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3ad9816c904550fb expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.620493:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3ad9816c904550fb expref: 18 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.620500:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805568:0@lo:104: 00000100:00100000:3.0:1787782118.620524:0:16492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782118.620533:0:16492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445391540 going to sleep for 11 seconds 00000100:00100000:1.0:1787782118.620619:0:14361:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787782118.620640:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023805312 00000100:00100000:1.0:1787782118.620647:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023805312 00000100:00100000:1.0:1787782118.620691:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023805440 00000100:00100000:1.0:1787782118.620693:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023805440 00000100:00100000:1.0:1787782118.620701:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023805568 00000100:00100000:1.0:1787782118.620703:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023805568 00000100:00100000:1.0:1787782118.620717:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787782118.620726:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+5:16492:x1874625023805312:12345-0@lo:104: 00010000:00010000:1.0:1787782118.620741:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.620823:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787782118.620830:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+5:16492:x1874625023805312:12345-0@lo:104: Request processed in 105us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782118.620848:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787782118.620866:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782118.620872:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+4:16492:x1874625023805440:12345-0@lo:104: 00010000:00010000:1.0:1787782118.620880:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.620913:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787782118.620917:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+4:16492:x1874625023805440:12345-0@lo:104: Request processed in 46us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782118.620923:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782118.620934:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787782118.620941:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:16492:x1874625023805568:12345-0@lo:104: 00010000:00010000:1.0:1787782118.620948:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.620971:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787782118.620988:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+3:16492:x1874625023805568:12345-0@lo:104: Request processed in 48us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782118.620994:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787782118.621039:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787782118.621046:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621055:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044c00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787782118.621060:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621081:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782118.621089:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782118.621096:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787782118.621128:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621135:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782118.621159:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621168:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef482044c00/0x3ad9816c90455283 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c9045528a expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621182:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782118.621185:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621190:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8c00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787782118.621193:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621201:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782118.621207:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782118.621218:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787782118.621231:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621238:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782118.621244:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621250:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8c00/0x3ad9816c90455148 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c9045514f expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621258:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782118.621261:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621267:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9e00 already unused, calling callback (ffffffffc1d18c20) 10000000:00010000:1.0:1787782118.621270:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621276:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782118.621282:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782118.621288:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787782118.621297:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621303:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782118.621324:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621332:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9ef4432b9e00/0x3ad9816c904550fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3ad9816c90455102 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621346:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782118.621348:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782118.621350:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782118.621370:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3303:1874625023805696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787782118.621401:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782118.621432:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782118.621436:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3303:1874625023805824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787782118.621454:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782118.621477:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023805952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787782118.621500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782118.621530:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023805696 00000100:00100000:1.0:1787782118.621534:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023805696 00010000:00010000:1.0:1787782118.621553:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90455283 expref: 19 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782118.621568:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023805824 00000100:00100000:1.0:1787782118.621570:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023805824 00010000:00010000:1.0:1787782118.621580:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90455148 expref: 20 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782118.621590:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023805952 00000100:00100000:1.0:1787782118.621592:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023805952 00010000:00010000:1.0:1787782118.621601:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904550fb expref: 21 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782118.621627:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787782118.621634:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+21:3303:x1874625023805696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782118.621646:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782118.621652:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90455283 expref: 21 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621662:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90455283 expref: 21 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621682:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782118.621712:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+21:3303:x1874625023805696:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782118.621720:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787782118.621735:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782118.621741:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+20:3303:x1874625023805824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782118.621749:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782118.621754:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c90455148 expref: 20 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621762:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c90455148 expref: 20 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621771:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782118.621829:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+20:3303:x1874625023805824:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782118.621835:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782118.621846:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787782118.621859:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3305:x1874625023805952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782118.621866:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782118.621871:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3ad9816c904550fb expref: 19 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621879:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3ad9816c904550fb expref: 19 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782118.621888:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782118.621913:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3305:x1874625023805952:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782118.621918:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787782118.622021:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3305:1874625023805952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787782118.622050:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3303:1874625023805824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787782118.622058:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3303:1874625023805696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782118.622362:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782118.623136:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef48183ec00/0x3ad9816c9045528a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90455283 expref: 18 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.623155:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805312:0@lo:104: 00010000:00010000:3.0:1787782118.623168:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef450ba2c00/0x3ad9816c9045514f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c90455148 expref: 17 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.623176:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805440:0@lo:104: 00010000:00010000:3.0:1787782118.623187:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef48183fc00/0x3ad9816c90455102 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3ad9816c904550fb expref: 16 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.623196:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805568:0@lo:104: 00000100:00100000:3.0:1787782118.627131:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805056:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787782118.627172:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874625023805184:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787782118.627221:0:16492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782118.627364:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782118.627428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782118.627512:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005991168 00000100:00100000:3.0:1787782118.627520:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005991168 00010000:00010000:3.0:1787782118.627562:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd51 expref: 13 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.627600:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005991296 00000100:00100000:3.0:1787782118.627603:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005991296 00010000:00010000:3.0:1787782118.627616:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcef expref: 14 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782118.627631:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1787782118.627639:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03474bc7-848a-4d95-ae7f-d483d1ea7417+14:2352:x1874625005991168:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782118.627655:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782118.627661:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd51 expref: 14 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627673:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd51 expref: 14 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627737:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482044a00/0x3ad9816c904553e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd51 expref: 14 pid: 14373 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627755:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782118.627834:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:2352:x1874625005991168:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 195us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782118.627853:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1787782118.627873:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:3.0:1787782118.627877:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:2352:x1874625005991296:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782118.627884:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782118.627887:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcef expref: 12 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627893:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcef expref: 12 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627900:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef4432b8a00/0x3ad9816c904553a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dcef expref: 12 pid: 14370 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627909:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627916:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627928:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627935:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627942:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627949:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627963:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782118.627969:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.627989:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.628005:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.628016:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782118.628036:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:2352:x1874625005991296:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 158us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782118.628041:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00010000:00010000:3.0:1787782118.628059:0:16492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.628065:0:16492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782118.628069:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ef482045200/0x3ad9816c9045540b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782119.490094:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782119.619567:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023806080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782119.619672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782119.619782:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023806080 00000100:00100000:2.0:1787782119.619809:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023806080 00000100:00100000:2.0:1787782119.619889:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787782119.619900:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023806080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787782119.619950:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782119.620019:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625023806080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.620028:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787782119.620057:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782119.620108:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874625023806080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782119.624434:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782119.624465:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023806464:0@lo:400:kworker.0 00000100:00100000:0.0:1787782119.624556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782119.624618:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023806464 00000100:00100000:0.0:1787782119.624627:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023806464 00000100:00100000:0.0:1787782119.624685:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787782119.624695:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023806464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782119.624753:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625023806464:12345-0@lo:400:kworker.0 Request processed in 59us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.624761:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787782119.624833:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625023806464:0@lo:400:kworker.0 00000100:00100000:0.0:1787782119.624870:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625023806592:0@lo:400:kworker.0 00000100:00100000:0.0:1787782119.624908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782119.624938:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023806592 00000100:00100000:0.0:1787782119.624942:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023806592 00000100:00100000:0.0:1787782119.624992:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787782119.624998:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625023806592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782119.625035:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b42d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625023806592:12345-0@lo:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.625041:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787782119.625059:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782119.625083:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625023806592:0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.626483:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3303:1874625023806208:0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.626567:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782119.626637:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023806720:0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.626676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782119.626706:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782119.626714:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023806336:0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.626743:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782119.626804:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023806336 00000100:00100000:2.0:1787782119.626812:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023806336 00000100:00100000:2.0:1787782119.626872:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782119.626882:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023806336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.626961:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023806336:12345-0@lo:400:kworker.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.626982:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782119.627031:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b41a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023806336:0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.627085:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023806208 00000100:00100000:2.0:1787782119.627089:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023806208 00000100:00100000:2.0:1787782119.627117:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787782119.627124:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:3303:x1874625023806208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.627162:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478959c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:3303:x1874625023806208:12345-0@lo:400:kworker.0 Request processed in 38us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.627168:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787782119.628547:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023806720 00000100:00100000:0.0:1787782119.628560:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023806720 00000100:00100000:0.0:1787782119.628624:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787782119.628633:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023806720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782119.628709:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625023806720:12345-0@lo:400:kworker.0 Request processed in 77us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.628716:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787782119.628737:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782119.628742:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782119.631410:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b430c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3303:1874625023806208:0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.631436:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b42580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625023806720:0@lo:400:kworker.0 00000100:00100000:2.0:1787782119.684193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782119.685297:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005991424 00000100:00100000:0.0:1787782119.685313:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005991424 00000100:00100000:0.0:1787782119.685395:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 105 00000100:00100000:0.0:1787782119.685410:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+11:13768:x1874625005991424:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782119.685434:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782119.685461:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440031800/0x3ad9816c90455412 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd82 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.685514:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440031800/0x3ad9816c90455412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd82 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.685528:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440031800/0x3ad9816c90455412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd82 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782119.685540:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031800, rc 0) 00000100:00100000:0.0:1787782119.685629:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13768:x1874625005991424:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 223us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782119.685637:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 105 00000100:00100000:1.0:1787782119.709460:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782119.709832:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005991552 00000100:00100000:2.0:1787782119.709845:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005991552 00000100:00100000:2.0:1787782119.709916:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 106 00000100:00100000:2.0:1787782119.709927:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13768:x1874625005991552:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782119.710288:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13768:x1874625005991552:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 362us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.710298:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 106 00000100:00100000:2.0:1787782119.713361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782119.713431:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005991680 00000100:00100000:0.0:1787782119.713444:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005991680 00000100:00100000:0.0:1787782119.713518:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:0.0:1787782119.713532:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13768:x1874625005991680:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782119.714327:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13768:x1874625005991680:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 793us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782119.714339:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:1.0:1787782119.718453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782119.718582:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005991808 00000100:00100000:2.0:1787782119.718594:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005991808 00000100:00100000:2.0:1787782119.718671:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:2.0:1787782119.718683:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+12:13768:x1874625005991808:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782119.718708:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782119.718733:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef4432b9800/0x3ad9816c90455419 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd89 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782119.718773:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef4432b9800/0x3ad9816c90455419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd89 expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782119.718810:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef4432b9800/0x3ad9816c90455419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd89 expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782119.718821:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9800, rc 0) 00000100:00100000:2.0:1787782119.718889:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13768:x1874625005991808:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 209us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.718899:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:0.0:1787782119.720872:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782119.720958:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005991936 00000100:00100000:1.0:1787782119.720985:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005991936 00000100:00100000:1.0:1787782119.721049:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 109 00000100:00100000:1.0:1787782119.721060:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13768:x1874625005991936:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782119.721453:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13768:x1874625005991936:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 394us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782119.721463:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 109 00000100:00100000:1.0:1787782119.724551:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782119.724772:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005992064 00000100:00100000:2.0:1787782119.724785:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005992064 00000100:00100000:2.0:1787782119.724885:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 110 00000100:00100000:2.0:1787782119.724897:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13768:x1874625005992064:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782119.725212:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478959450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:13768:x1874625005992064:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 316us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782119.725221:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 110 00000100:00100000:3.0:1787782120.126062:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782120.126086:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023806848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782120.126149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782120.126206:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023806848 00000100:00100000:3.0:1787782120.126212:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023806848 00000100:00100000:3.0:1787782120.126250:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787782120.126268:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023806848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782120.126446:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782120.126525:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023806848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 257us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782120.126532:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787782120.131895:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023806848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787782120.512165:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787782120.573912:0:14375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787782120.573925:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef479c77800 from 10 10000000:01000000:1.0:1787782120.573932:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782120.574014:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183e200/0x3ad9816c90455420 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782120.574029:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef48183e200/0x3ad9816c90455420 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782120.574042:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef48183e200/0x3ad9816c90455420 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782120.574075:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023806976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782120.574168:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782120.574240:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801480 going to sleep for 11 seconds 00000100:00100000:0.0:1787782120.574309:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023806976 00000100:00100000:0.0:1787782120.574320:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023806976 00000100:00100000:0.0:1787782120.574390:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787782120.574402:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+16:14375:x1874625023806976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782120.574419:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782120.574438:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440030400/0x3ad9816c90455427 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c90455420 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.574484:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440030400/0x3ad9816c90455427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c90455420 expref: 17 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.574498:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440030400/0x3ad9816c90455427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c90455420 expref: 17 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.574531:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030400, rc 0) 00000100:00100000:0.0:1787782120.574594:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:14375:x1874625023806976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.574602:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787782120.574665:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023806976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782120.574690:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef48183e200/0x3ad9816c90455420 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455427 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782120.574700:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef48183e200/0x3ad9816c90455420 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90455427 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782120.574776:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782120.574837:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782120.574853:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450ce1600 going to sleep for 11 seconds 00000100:00100000:1.0:1787782120.574922:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023807104 00000100:00100000:1.0:1787782120.574928:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023807104 00000100:00100000:1.0:1787782120.574970:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787782120.574978:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:14375:x1874625023807104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782120.575291:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:14375:x1874625023807104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782120.575299:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787782120.575607:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782120.575643:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782120.575684:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782120.575715:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450ce1600 going to sleep for 11 seconds 00000100:00100000:1.0:1787782120.575996:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023807232 00000100:00100000:1.0:1787782120.576002:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023807232 00000100:00100000:1.0:1787782120.576076:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787782120.576084:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:14375:x1874625023807232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782120.576280:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:14375:x1874625023807232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782120.576288:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787782120.576368:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787782120.577260:0:16573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787782120.577466:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787782120.577486:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787782120.577498:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef48183e200/0x3ad9816c90455420 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455427 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782120.577511:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef48183e200/0x3ad9816c90455420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455427 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782120.577524:0:14375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787782120.577527:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef444cb3000 from 10 10000000:01000000:3.0:1787782120.577531:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782120.577568:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045200/0x3ad9816c9045542e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782120.577577:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef482045200/0x3ad9816c9045542e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782120.577587:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef482045200/0x3ad9816c9045542e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782120.577609:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787782120.577663:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782120.584392:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023807360 00000100:00100000:0.0:1787782120.584417:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023807360 00000100:00100000:0.0:1787782120.585661:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787782120.585687:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47895b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+17:14375:x1874625023807360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782120.585713:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782120.585740:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440030a00/0x3ad9816c90455435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c9045542e expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.585777:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440030a00/0x3ad9816c90455435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c9045542e expref: 18 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.585809:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440030a00/0x3ad9816c90455435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c9045542e expref: 18 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.585821:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030a00, rc 0) 00000100:00100000:0.0:1787782120.585921:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47895b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:14375:x1874625023807360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (8258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.585929:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787782120.586231:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445391c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782120.586268:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782120.586315:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef482045200/0x3ad9816c9045542e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455435 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782120.586327:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef482045200/0x3ad9816c9045542e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90455435 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782120.586431:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782120.586498:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782120.586534:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445391c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782120.586660:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023807488 00000100:00100000:0.0:1787782120.586668:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023807488 00000100:00100000:0.0:1787782120.586699:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787782120.586707:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:14375:x1874625023807488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782120.587090:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:14375:x1874625023807488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 383us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.587106:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787782120.589786:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782120.589929:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782120.590046:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782120.590101:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445391c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782120.590925:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023807616 00000100:00100000:0.0:1787782120.590934:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023807616 00000100:00100000:0.0:1787782120.591004:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787782120.591017:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:14375:x1874625023807616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782120.591418:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:14375:x1874625023807616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 403us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.591428:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787782120.591832:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787782120.598407:0:16574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787782120.599860:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787782120.599896:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782120.599911:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef482045200/0x3ad9816c9045542e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455435 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782120.599925:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef482045200/0x3ad9816c9045542e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455435 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782120.599940:0:14375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787782120.599943:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ef4818d0000 from 10 10000000:01000000:2.0:1787782120.599946:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787782120.600016:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c9045543c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782120.600045:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c9045543c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782120.600059:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c9045543c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782120.600097:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef4790a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787782120.600862:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782120.600936:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef452157e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782120.600941:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023807744 00000100:00100000:0.0:1787782120.600953:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023807744 00000100:00100000:0.0:1787782120.601405:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787782120.601428:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+18:14375:x1874625023807744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782120.601447:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782120.601469:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455443 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ad9816c9045543c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.601513:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3ad9816c9045543c expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.601528:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ef440030e00/0x3ad9816c90455443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3ad9816c9045543c expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782120.601540:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030e00, rc 0) 00000100:00100000:0.0:1787782120.601630:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:14375:x1874625023807744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.601639:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787782120.601980:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef4790a61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782120.602003:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c9045543c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455443 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782120.602015:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c9045543c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3ad9816c90455443 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782120.602102:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782120.602141:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782120.602173:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445391c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787782120.602301:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023807872 00000100:00100000:2.0:1787782120.602307:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023807872 00000100:00100000:2.0:1787782120.602347:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787782120.602355:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:14375:x1874625023807872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782120.606548:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:14375:x1874625023807872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4176us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782120.606570:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787782120.608163:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023807872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782120.608271:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023808000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782120.608362:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782120.608412:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445391c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782120.608414:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023808000 00000100:00100000:0.0:1787782120.608424:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023808000 00000100:00100000:0.0:1787782120.608593:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787782120.608605:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:14375:x1874625023808000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782120.609382:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:14375:x1874625023808000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 775us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782120.609392:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787782120.609558:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd82860a-d07d-4a23-81c4-f74b9aa945b8:14375:1874625023808000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787782120.619438:0:16575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787782120.641231:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787782120.641282:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787782120.641297:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c9045543c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455443 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782120.641313:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9ef4432b8400/0x3ad9816c9045543c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3ad9816c90455443 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782121.413151:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782121.413193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782121.413231:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782121.413257:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782121.413273:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782121.413290:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782121.413310:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782121.413338:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005992576 00000100:00100000:2.0:1787782121.413348:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005992576 00000100:00100000:2.0:1787782121.413399:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005992832 00000100:00100000:2.0:1787782121.413403:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005992832 00000100:00100000:2.0:1787782121.413433:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005992448 00000100:00100000:2.0:1787782121.413447:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005992448 00000100:00100000:2.0:1787782121.413461:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005992960 00000100:00100000:2.0:1787782121.413464:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005992960 00000100:00100000:2.0:1787782121.413478:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:2.0:1787782121.413487:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2349:x1874625005992576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782121.413556:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2349:x1874625005992576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 69us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782121.413564:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:2.0:1787782121.413581:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1787782121.413587:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2349:x1874625005992832:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782121.413611:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2349:x1874625005992832:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782121.413617:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1787782121.413626:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:2.0:1787782121.413631:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f556580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2349:x1874625005992448:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782121.413650:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f556580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2349:x1874625005992448:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782121.413655:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:2.0:1787782121.413663:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:2.0:1787782121.413668:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f554b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2349:x1874625005992960:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1787782121.413686:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f554b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2349:x1874625005992960:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782121.413692:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:1.0:1787782121.413892:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005992320 00000100:00100000:1.0:1787782121.413897:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005992320 00000100:00100000:1.0:1787782121.413935:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005992704 00000100:00100000:1.0:1787782121.413938:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005992704 00000100:00100000:1.0:1787782121.413967:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:1.0:1787782121.413974:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2350:x1874625005992320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787782121.414004:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4790a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2350:x1874625005992320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782121.414010:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:1.0:1787782121.414022:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1787782121.414028:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f556d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2349:x1874625005992704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787782121.414050:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f556d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2349:x1874625005992704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782121.414057:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:3.0:1787782121.414379:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005992192 00000100:00100000:3.0:1787782121.414384:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005992192 00000100:00100000:3.0:1787782121.414419:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:3.0:1787782121.414426:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:2350:x1874625005992192:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1787782121.414469:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:2350:x1874625005992192:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 43us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782121.414476:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00080000:0.0:1787782121.415578:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782121.415587:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787782121.415590:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787782121.538783:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787782121.982513:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787782122.156982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.157250:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005993088 00000100:00100000:1.0:1787782122.157262:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005993088 00000100:00100000:1.0:1787782122.157333:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1787782122.157344:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:14420:x1874625005993088:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782122.157366:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782122.157404:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045544a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd90 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.157481:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.157497:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.157510:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.157530:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.157538:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.157544:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158036:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c9045545f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158047:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c9045545f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158055:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c9045545f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782122.158145:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787782122.158149:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782122.158248:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c9045545f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158267:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158273:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158280:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158286:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183fc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787782122.158290:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158297:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158310:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45497c100) 00010000:00010000:1.0:1787782122.158313:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782122.158317:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158324:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c90455451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158337:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158344:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158349:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158361:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787782122.158365:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158371:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158379:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ef448467800) 00010000:00010000:1.0:1787782122.158382:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782122.158384:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158390:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455458 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158423:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045544a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd90 expref: 8 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158436:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e000/0x3ad9816c9045545f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd90 expref: 7 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.158444:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef448467100) 00010000:00010000:1.0:1787782122.158446:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787782122.158449:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e000, rc 0) 00000100:00100000:1.0:1787782122.158517:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+7:14420:x1874625005993088:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1175us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782122.158524:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:0.0:1787782122.163063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.165141:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005993344 00000100:00100000:2.0:1787782122.165157:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005993344 00000100:00100000:2.0:1787782122.165242:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:2.0:1787782122.165255:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+7:14420:x1874625005993344:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782122.165277:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782122.165299:0:15085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455466 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd97 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.165376:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.165391:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.165402:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.165474:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.165483:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.165490:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166060:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c9045547b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166070:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c9045547b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166085:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c9045547b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782122.166096:0:15085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787782122.166349:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166357:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166364:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166370:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.166374:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166381:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166395:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ef448467100) 00010000:00010000:2.0:1787782122.166398:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.166403:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166409:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c9045546d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166421:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166426:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166438:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166443:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.166446:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166453:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166461:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ef45088ae00) 00010000:00010000:2.0:1787782122.166464:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.166467:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166472:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455474 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166977:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455466 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd97 expref: 10 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.166995:0:15085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8c00/0x3ad9816c9045547b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd97 expref: 9 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.167002:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef45088a300) 00010000:00010000:2.0:1787782122.167004:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.167006:0:15085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8c00, rc 0) 00000100:00100000:2.0:1787782122.167080:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b43840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+9:14420:x1874625005993344:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1828us (4033us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787782122.167100:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:2.0:1787782122.177252:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.177460:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005993472 00000100:00100000:1.0:1787782122.177483:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005993472 00000100:00100000:1.0:1787782122.177549:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1787782122.177561:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f5570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+9:14420:x1874625005993472:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787782122.177673:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f5570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+9:14420:x1874625005993472:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 115us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782122.177681:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1787782122.244655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.244839:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005993600 00000100:00100000:2.0:1787782122.244851:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005993600 00000100:00100000:2.0:1787782122.244926:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1787782122.244949:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+9:14426:x1874625005993600:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787782122.244986:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782122.245018:0:15085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dd9e expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245111:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245129:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245146:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245164:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245173:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245180:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245616:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245632:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245639:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245645:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.245650:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245658:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245672:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45497c100) 00010000:00010000:2.0:1787782122.245675:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.245679:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245686:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455490 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245699:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245705:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245710:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245715:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.245721:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245727:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245733:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef45088ae00) 00010000:00010000:2.0:1787782122.245735:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.245737:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245742:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455497 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245784:0:15085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455489 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd9e expref: 10 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245858:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45497c100) 00010000:00010000:2.0:1787782122.245861:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.245864:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd9e expref: 10 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.245875:0:15085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8600, rc 0) 00000100:00100000:2.0:1787782122.246274:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+9:14426:x1874625005993600:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1334us (1634us total) trans 0 rc 301/301 00000100:00100000:2.0:1787782122.246284:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:3.0:1787782122.262149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782122.262680:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005993728 00000100:00100000:3.0:1787782122.262695:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005993728 00000100:00100000:3.0:1787782122.262829:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:3.0:1787782122.262841:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f79631f7-3d35-46c8-af7e-18b9151ff291+9:14426:x1874625005993728:12345-192.168.202.56@tcp:700:lfs.0 00000100:00100000:3.0:1787782122.262981:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f79631f7-3d35-46c8-af7e-18b9151ff291+9:14426:x1874625005993728:12345-192.168.202.56@tcp:700:lfs.0 Request processed in 141us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782122.263012:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1787782122.274643:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.276552:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005993984 00000100:00100000:1.0:1787782122.276574:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005993984 00000100:00100000:1.0:1787782122.276656:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1787782122.276669:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+9:14426:x1874625005993984:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:1.0:1787782122.276748:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782122.277096:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045c00/0x3ad9816c904553cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd19 expref: 9 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.277122:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45497c100) 00010000:00010000:1.0:1787782122.277129:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782122.277674:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.277695:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd7b expref: 5 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.277706:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.277751:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd7b expref: 5 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.278415:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd7b expref: 5 pid: 14378 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782122.278438:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1874625023808128:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787782122.278581:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782122.281495:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1874625023808128:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787782122.281538:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782122.284135:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782122.284257:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005994112 00000100:00100000:3.0:1787782122.284272:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005994112 00010000:00010000:3.0:1787782122.284340:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd7b expref: 6 pid: 14378 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782122.284393:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1787782122.284405:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2352:x1874625005994112:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782122.284424:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782122.284433:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd7b expref: 6 pid: 14378 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.284450:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd7b expref: 6 pid: 14378 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.284481:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c90455404 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dd7b expref: 6 pid: 14378 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.284504:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45497c100) 00010000:00010000:3.0:1787782122.284510:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.284521:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.284531:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.284601:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782122.284672:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2352:x1874625005994112:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 268us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782122.284682:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00010000:00010000:0.0:1787782122.285394:0:14377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.285408:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.285444:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.285459:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.285471:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782122.291681:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787782122.291714:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.291727:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.291745:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.291752:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787782122.291759:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.291769:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.292383:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45497c100) 00010000:00010000:0.0:1787782122.292389:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782122.292396:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.292405:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c9045549e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787782122.292436:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4085db4 reply state 00000000270c90c6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782122.292446:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787782122.292641:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+10:14426:x1874625005993984:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 15968us (18006us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787782122.292653:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00010000:00010000:0.0:1787782122.308153:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.308178:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.308209:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.308216:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787782122.308223:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.308232:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.308252:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef44a880c00) 00010000:00010000:0.0:1787782122.308256:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782122.308262:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.308269:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c904554a5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782122.399092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.399618:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005994240 00000100:00100000:2.0:1787782122.399632:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005994240 00000100:00100000:2.0:1787782122.399745:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1787782122.399757:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+9:14434:x1874625005994240:12345-192.168.202.56@tcp:101:lctl.0 00010000:00010000:2.0:1787782122.399851:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782122.399889:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904554ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dda5 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.400005:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c904554b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.400026:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c904554b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.400040:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c904554b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782122.400127:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787782122.400132:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782122.400205:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c904554b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.400237:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904554ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dda5 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.400261:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8a00/0x3ad9816c904554b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dda5 expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.400271:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787782122.400275:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782122.400279:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8a00, rc 0) 00000100:00100000:2.0:1787782122.400365:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+10:14434:x1874625005994240:12345-192.168.202.56@tcp:101:lctl.0 Request processed in 611us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782122.400383:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1787782122.431622:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782122.433324:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005994368 00000100:00100000:3.0:1787782122.433346:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005994368 00000100:00100000:3.0:1787782122.433448:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:3.0:1787782122.433462:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:14435:x1874625005994368:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1787782122.433491:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782122.433521:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c904554ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddac expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.433612:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044a00/0x3ad9816c904554c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.433631:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044a00/0x3ad9816c904554c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.433646:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044a00/0x3ad9816c904554c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782122.433728:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787782122.433733:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782122.433763:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044a00/0x3ad9816c904554c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.434370:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044800/0x3ad9816c904554ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddac expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.434428:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482044a00/0x3ad9816c904554c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddac expref: 6 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782122.434439:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:3.0:1787782122.434443:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782122.434448:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482044a00, rc 0) 00000100:00100000:2.0:1787782122.439986:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:14435:x1874625005994368:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6497us (8350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782122.440005:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:1.0:1787782122.445345:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.445459:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005994496 00000100:00100000:2.0:1787782122.445471:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005994496 00000100:00100000:2.0:1787782122.445586:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:2.0:1787782122.445598:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:14435:x1874625005994496:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787782122.445625:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782122.445652:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904554c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddb3 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.445745:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.445762:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.445774:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.445828:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.445836:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.445842:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449206:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904554dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449233:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904554dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449246:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904554dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782122.449322:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787782122.449326:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782122.449355:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904554dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449371:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449378:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449384:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449391:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.449395:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449403:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449417:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787782122.449434:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.449440:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449446:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449463:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449468:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449474:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449478:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.449480:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449485:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449491:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef45088ad00) 00010000:00010000:2.0:1787782122.449494:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.449496:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449501:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449538:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904554c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddb3 expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449562:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904554dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddb3 expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.449569:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef45088a800) 00010000:00010000:2.0:1787782122.449571:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782122.449573:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9200, rc 0) 00000100:00100000:2.0:1787782122.449648:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+7:14435:x1874625005994496:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4051us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782122.449656:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:0.0:1787782122.460495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.460626:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005994752 00000100:00100000:1.0:1787782122.460643:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005994752 00000100:00100000:1.0:1787782122.460733:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:1.0:1787782122.460745:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+7:14435:x1874625005994752:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1787782122.460778:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782122.460856:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c904554e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddba expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782122.461335:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787782122.461514:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c904554e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddba expref: 9 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.461533:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:1.0:1787782122.461536:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787782122.461543:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c904554e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddba expref: 9 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.461580:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f600, rc 0) 00000100:00100000:1.0:1787782122.461726:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+8:14435:x1874625005994752:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 981us (1245us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787782122.461737:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:0.0:1787782122.466266:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.466434:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005995008 00000100:00100000:2.0:1787782122.466448:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005995008 00000100:00100000:2.0:1787782122.466560:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:2.0:1787782122.466575:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+8:14435:x1874625005995008:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1787782122.466660:0:15085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782122.466697:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904554dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddb3 expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.466720:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef45088a800) 00010000:00010000:2.0:1787782122.466734:0:15085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782122.466767:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.466836:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.466849:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782122.467322:0:15085:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3f15c83 reply state 00000000dc7fcf8a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782122.467336:0:15085:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787782122.467353:0:15085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787782122.467476:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+9:14435:x1874625005995008:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 901us (1224us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787782122.467485:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00010000:00010000:0.0:1787782122.470436:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.470461:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.470470:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.470501:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787782122.470507:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.470516:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.470540:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef45088ad00) 00010000:00010000:0.0:1787782122.470544:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787782122.470550:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.470557:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c904554f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782122.471835:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.471927:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005995264 00000100:00100000:1.0:1787782122.471950:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005995264 00000100:00100000:1.0:1787782122.472030:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1787782122.472043:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+8:14435:x1874625005995264:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1787782122.472439:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+9:14435:x1874625005995264:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 397us (658us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787782122.472450:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1787782122.476864:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.476997:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005995520 00000100:00100000:2.0:1787782122.477011:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005995520 00000100:00100000:2.0:1787782122.477087:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:2.0:1787782122.477099:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+9:14435:x1874625005995520:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1787782122.477132:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782122.477158:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddc1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477260:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477279:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477293:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477313:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477321:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477347:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782122.477537:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787782122.477661:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477669:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477677:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477683:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.477688:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477697:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477712:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787782122.477716:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.477722:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477730:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477744:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477761:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477767:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477772:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.477775:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477781:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477848:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef45088a800) 00010000:00010000:2.0:1787782122.477851:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.477854:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477860:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c90455507 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477910:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc1 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477922:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787782122.477924:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787782122.477928:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904554f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc1 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.477969:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8600, rc 0) 00000100:00100000:2.0:1787782122.478043:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+10:14435:x1874625005995520:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 946us (1193us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787782122.478053:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:2.0:1787782122.488195:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782122.488395:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005995648 00000100:00100000:0.0:1787782122.488409:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005995648 00000100:00100000:0.0:1787782122.488490:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:0.0:1787782122.488502:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+10:14435:x1874625005995648:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787782122.488535:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782122.488566:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90455515 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddc8 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.488685:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.488704:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.488746:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782122.488885:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787782122.488899:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782122.488933:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.489246:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90455515 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc8 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.489271:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc8 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.489281:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef44a880c00) 00010000:00010000:0.0:1787782122.489284:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782122.489289:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030c00, rc 0) 00000100:00100000:0.0:1787782122.489379:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+11:14435:x1874625005995648:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 879us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782122.489390:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:0.0:1787782122.503908:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.504174:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005995776 00000100:00100000:1.0:1787782122.504187:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005995776 00000100:00100000:1.0:1787782122.504266:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:1.0:1787782122.504279:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+11:14435:x1874625005995776:12345-192.168.202.56@tcp:37:lfs.0 00000100:00100000:2.0:1787782122.513882:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+11:14435:x1874625005995776:12345-192.168.202.56@tcp:37:lfs.0 Request processed in 9584us (9977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782122.513909:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1787782122.518128:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.518622:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005996032 00000100:00100000:2.0:1787782122.518635:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005996032 00000100:00100000:2.0:1787782122.518713:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1787782122.518726:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4450a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+11:14435:x1874625005996032:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1787782122.519414:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4450a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+12:14435:x1874625005996032:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 685us (1299us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787782122.519425:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00010000:00010000:2.0:1787782122.558028:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782122.581599:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.581772:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005996160 00000100:00100000:2.0:1787782122.581834:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005996160 00000100:00100000:2.0:1787782122.581922:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1787782122.581935:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+10:14442:x1874625005996160:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787782122.581992:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782122.582021:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455523 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddcf expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582114:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582149:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582437:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582460:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582468:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582476:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582636:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455538 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582646:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582654:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782122.582693:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787782122.582698:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782122.582747:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582763:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582823:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582831:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582838:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.582844:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582853:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582869:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:2.0:1787782122.582872:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.582877:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.582884:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045552a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583290:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583297:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583304:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583309:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.583322:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583330:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583340:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ef45088a800) 00010000:00010000:2.0:1787782122.583343:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.583346:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583352:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455531 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583396:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddcf expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583412:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9e00/0x3ad9816c90455538 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddcf expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.583420:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef44a880c00) 00010000:00010000:2.0:1787782122.583422:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787782122.583425:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9e00, rc 0) 00000100:00100000:2.0:1787782122.583578:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+11:14442:x1874625005996160:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1644us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782122.583587:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:0.0:1787782122.598203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.598321:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005996416 00000100:00100000:2.0:1787782122.598335:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005996416 00000100:00100000:2.0:1787782122.598407:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:2.0:1787782122.598419:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+11:14442:x1874625005996416:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1787782122.598469:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782122.598496:0:15085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045553f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddd6 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.598683:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.598700:0:15085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc8 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.598710:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.598752:0:15085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc8 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.598769:0:15085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc8 expref: 11 pid: 14379 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782122.598784:0:15085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f5561c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1874625023808256:192.168.202.56@tcp:104: 00000100:00100000:2.0:1787782122.598954:0:15085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef452157000 going to sleep for 11 seconds 00000100:00100000:0.0:1787782122.602662:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782122.602877:0:15085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f5561c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15085:1874625023808256:192.168.202.56@tcp:104: 00010000:00010000:2.0:1787782122.602927:0:15085:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782122.603406:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005996544 00000100:00100000:1.0:1787782122.603416:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005996544 00010000:00010000:1.0:1787782122.603473:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc8 expref: 12 pid: 14379 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782122.603521:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1787782122.603533:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+12:2351:x1874625005996544:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782122.603587:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782122.603595:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc8 expref: 12 pid: 14379 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.603610:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc8 expref: 12 pid: 14379 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.603637:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c9045551c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddc8 expref: 12 pid: 14379 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.603659:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef44a880c00) 00010000:00010000:1.0:1787782122.603664:0:14365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.603675:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.603684:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.603722:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782122.603874:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+11:2351:x1874625005996544:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 342us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782122.603883:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00010000:00010000:2.0:1787782122.605424:0:15085:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.605443:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.605505:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.605521:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.605533:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.607031:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.607052:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.607063:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782122.607079:0:15085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787782122.607125:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.607132:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.607141:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.607147:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.607153:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.608125:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.608148:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef44a880c00) 00010000:00010000:2.0:1787782122.608151:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.608159:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.608181:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c90455546 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782122.608204:0:15085:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001082460d reply state 000000002d8c8c46 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782122.608215:0:15085:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787782122.608278:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045553f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddd6 expref: 14 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.608295:0:15085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddd6 expref: 13 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.608303:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:2.0:1787782122.608306:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787782122.608309:0:15085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9a00, rc 0) 00000100:00100000:2.0:1787782122.608415:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b43c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+14:14442:x1874625005996416:12345-192.168.202.56@tcp:101:bash.0 Request processed in 9997us (10226us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787782122.608426:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00010000:00010000:2.0:1787782122.614328:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.614376:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.614386:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.614393:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.614399:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.614408:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.614429:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ef45088a800) 00010000:00010000:2.0:1787782122.614433:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782122.614438:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.614445:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045554d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782122.625603:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.626118:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005996672 00000100:00100000:1.0:1787782122.626132:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005996672 00000100:00100000:1.0:1787782122.626230:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:1.0:1787782122.626245:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+13:14442:x1874625005996672:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1787782122.626517:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782122.626556:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c90455562 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dddd expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.626648:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.626666:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.626680:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782122.626730:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787782122.626734:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782122.626761:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.626775:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.626866:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c90455562 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dddd expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.626888:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dddd expref: 14 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.626898:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782122.626901:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782122.626905:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f400, rc 0) 00000100:00100000:1.0:1787782122.627015:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+14:14442:x1874625005996672:12345-192.168.202.56@tcp:101:bash.0 Request processed in 773us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782122.627024:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:0.0:1787782122.632829:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.633181:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005996928 00000100:00100000:1.0:1787782122.633194:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005996928 00000100:00100000:1.0:1787782122.633265:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:1.0:1787782122.633278:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+14:14442:x1874625005996928:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:1.0:1787782122.633910:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+15:14442:x1874625005996928:12345-192.168.202.56@tcp:35:bash.0 Request processed in 633us (1144us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787782122.633920:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:3.0:1787782122.782768:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782122.783260:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005997184 00000100:00100000:0.0:1787782122.783273:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005997184 00000100:00100000:0.0:1787782122.783361:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:0.0:1787782122.783396:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+15:14452:x1874625005997184:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787782122.783430:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782122.783461:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90455570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140dde4 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782122.783622:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787782122.783752:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90455570 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dde4 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.783768:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ef45088ae00) 00010000:00010000:0.0:1787782122.783771:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782122.783776:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90455570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dde4 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.783835:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031400, rc 0) 00000100:00100000:0.0:1787782122.784081:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+16:14452:x1874625005997184:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 689us (1325us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787782122.784088:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:0.0:1787782122.787539:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.789175:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005997440 00000100:00100000:1.0:1787782122.789195:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005997440 00000100:00100000:1.0:1787782122.789278:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:1.0:1787782122.789290:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+16:14452:x1874625005997440:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1787782122.789745:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b42580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+17:14452:x1874625005997440:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 456us (2221us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787782122.789755:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1787782122.860421:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782122.860591:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005997696 00000100:00100000:0.0:1787782122.860603:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005997696 00000100:00100000:0.0:1787782122.860677:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:0.0:1787782122.860686:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f5561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+17:14455:x1874625005997696:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1787782122.860715:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782122.860738:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045557e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddeb expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.860915:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90455585 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.860931:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90455585 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.860952:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90455585 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782122.861322:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787782122.861522:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045557e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddeb expref: 20 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.861547:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90455585 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddeb expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782122.861558:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:0.0:1787782122.861562:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782122.861566:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030c00, rc 0) 00000100:00100000:0.0:1787782122.861729:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f5561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+19:14455:x1874625005997696:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1042us (1325us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787782122.861741:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:3.0:1787782122.865770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782122.866180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.866291:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005997952 00000100:00100000:1.0:1787782122.866305:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005997952 00000100:00100000:1.0:1787782122.866396:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:1.0:1787782122.866408:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+19:2351:x1874625005997952:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782122.866436:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782122.866471:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c90455585 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddeb expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782122.866496:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782122.866522:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782122.866604:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+18:2351:x1874625005997952:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 198us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782122.866614:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1787782122.868353:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005997824 00000100:00100000:2.0:1787782122.868371:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005997824 00000100:00100000:2.0:1787782122.868495:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:2.0:1787782122.868508:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14455:x1874625005997824:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1787782122.868599:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.868619:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.868651:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.868688:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.868696:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.868704:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.868710:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782122.868716:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.868724:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.868738:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:2.0:1787782122.868742:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787782122.868747:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782122.868754:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c90455593 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782122.869311:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14455:x1874625005997824:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 802us (3551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782122.869322:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:3.0:1787782122.871758:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782122.872007:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005998208 00000100:00100000:1.0:1787782122.872019:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005998208 00000100:00100000:1.0:1787782122.872092:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:1.0:1787782122.872104:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14455:x1874625005998208:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1787782122.872515:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+19:14455:x1874625005998208:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 410us (768us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787782122.872524:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000040:00080000:1.0:1787782123.006877:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787782123.218758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782123.219456:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005998464 00000100:00100000:1.0:1787782123.219470:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005998464 00000100:00100000:1.0:1787782123.219685:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:1.0:1787782123.219699:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+19:14486:x1874625005998464:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1787782123.219747:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782123.219775:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045559a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddf2 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.219949:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904555a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.219967:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904555a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.219981:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904555a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782123.220019:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787782123.220207:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045559a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddf2 expref: 22 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.220230:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904555a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddf2 expref: 21 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.220240:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782123.220243:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782123.220247:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183e400, rc 0) 00000100:00100000:1.0:1787782123.220339:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+21:14486:x1874625005998464:12345-192.168.202.56@tcp:101:cat.0 Request processed in 644us (1597us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787782123.220348:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00080000:0.0:1787782123.221121:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782123.224161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782123.224405:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005998592 00000100:00100000:1.0:1787782123.224418:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005998592 00000100:00100000:1.0:1787782123.224559:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:1.0:1787782123.224573:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+21:2351:x1874625005998592:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782123.224607:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782123.224648:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c904555a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddf2 expref: 21 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.224672:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782123.224677:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782123.224762:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+20:2351:x1874625005998592:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 193us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782123.224771:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:3.0:1787782123.225332:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782123.225374:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005998848 00000100:00100000:3.0:1787782123.225381:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005998848 00000100:00100000:3.0:1787782123.225443:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:3.0:1787782123.225468:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+20:14486:x1874625005998848:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:3.0:1787782123.226016:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+21:14486:x1874625005998848:12345-192.168.202.56@tcp:35:cat.0 Request processed in 547us (682us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787782123.226025:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:3.0:1787782123.286368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782123.286569:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005999104 00000100:00100000:0.0:1787782123.286582:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005999104 00000100:00100000:0.0:1787782123.286671:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:0.0:1787782123.286683:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+21:14492:x1874625005999104:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:0.0:1787782123.286757:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782123.286827:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904555af lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140ddf9 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.286978:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.286996:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddd6 expref: 22 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.287006:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dddd expref: 22 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.287017:0:14379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.287063:0:14379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dddd expref: 22 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.287079:0:14379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dddd expref: 22 pid: 14377 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782123.287095:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14379:1874625023808384:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787782123.287893:0:14379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddd6 expref: 22 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.287907:0:14379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddd6 expref: 22 pid: 15085 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782123.287948:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef448b41a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14379:1874625023808512:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787782123.288004:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef34316fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782123.294280:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14379:1874625023808384:192.168.202.56@tcp:104: 00000100:00100000:0.0:1787782123.294305:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef448b41a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14379:1874625023808512:192.168.202.56@tcp:104: 00010000:00010000:0.0:1787782123.294349:0:14379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782123.294690:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782123.294751:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782123.295049:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005999232 00000100:00100000:1.0:1787782123.295059:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005999232 00010000:00010000:1.0:1787782123.295113:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dddd expref: 23 pid: 14377 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782123.295153:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005999360 00000100:00100000:1.0:1787782123.295157:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005999360 00010000:00010000:1.0:1787782123.295170:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddd6 expref: 24 pid: 15085 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782123.295189:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:1.0:1787782123.295201:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f49e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+24:2352:x1874625005999232:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782123.295221:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782123.295230:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dddd expref: 24 pid: 14377 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295246:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dddd expref: 24 pid: 14377 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782123.295267:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787782123.295277:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c90455569 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140dddd expref: 24 pid: 14377 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782123.295297:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787782123.295300:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782123.295307:0:14365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295317:0:14365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295337:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782123.295412:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f49e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+23:2352:x1874625005999232:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 212us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782123.295421:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:1.0:1787782123.295488:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:1.0:1787782123.295496:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+22:2352:x1874625005999360:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782123.295505:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782123.295512:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddd6 expref: 22 pid: 15085 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295524:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddd6 expref: 22 pid: 15085 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295538:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455554 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddd6 expref: 22 pid: 15085 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295550:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782123.295554:0:14365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295562:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295571:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295599:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782123.295627:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+21:2352:x1874625005999360:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 132us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782123.295635:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00010000:00010000:1.0:1787782123.295661:0:14379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.295670:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782123.295693:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787782123.296058:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c904555af lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddf9 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.296075:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440030c00/0x3ad9816c904555b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140ddf9 expref: 21 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.296082:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782123.296085:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787782123.296087:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440030c00, rc 0) 00000100:00100000:1.0:1787782123.296125:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+21:14492:x1874625005999104:12345-192.168.202.56@tcp:101:dd.0 Request processed in 9445us (9772us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787782123.296133:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:3.0:1787782123.302661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782123.303081:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005999616 00000100:00100000:1.0:1787782123.303094:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005999616 00000100:00100000:1.0:1787782123.303170:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:1.0:1787782123.303183:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+21:14492:x1874625005999616:12345-192.168.202.56@tcp:36:dd.0 00010000:00010000:1.0:1787782123.303536:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.303585:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.303600:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787782123.303664:0:14377:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787782123.303708:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd3318eb reply state 00000000b835f9b5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782123.303719:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782123.303868:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+24:14492:x1874625005999616:12345-192.168.202.56@tcp:36:dd.0 Request processed in 685us (1220us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787782123.303879:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000020:00080000:1.0:1787782123.303886:0:14377:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787782123.313436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782123.313691:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625005999744 00000100:00100000:2.0:1787782123.313705:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625005999744 00000100:00100000:2.0:1787782123.313826:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:2.0:1787782123.313841:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+24:14492:x1874625005999744:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:2.0:1787782123.313876:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782123.313903:0:15085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140de00 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782123.313998:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de00 expref: 25 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782123.314016:0:15085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de00 expref: 25 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782123.314040:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:2.0:1787782123.314044:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782123.314049:0:15085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b8600, rc 0) 00000100:00100000:2.0:1787782123.314127:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+25:14492:x1874625005999744:12345-192.168.202.56@tcp:101:dd.0 Request processed in 289us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782123.314135:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00010000:00010000:0.0:1787782123.314405:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.314416:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.314423:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.314431:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1787782123.314436:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.314444:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.314458:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:0.0:1787782123.314461:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782123.314465:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782123.314495:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f400/0x3ad9816c904555c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782123.344489:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782123.344667:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006000000 00000100:00100000:3.0:1787782123.344681:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006000000 00000100:00100000:3.0:1787782123.344774:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:3.0:1787782123.344835:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+24:14492:x1874625006000000:12345-192.168.202.56@tcp:103:dd.0 00010000:00010000:3.0:1787782123.344856:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782123.344889:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de00 expref: 24 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782123.344912:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:3.0:1787782123.344919:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782123.344992:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+23:14492:x1874625006000000:12345-192.168.202.56@tcp:103:dd.0 Request processed in 160us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782123.345002:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:3.0:1787782123.347897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782123.348178:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006000128 00000100:00100000:1.0:1787782123.348192:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006000128 00000100:00100000:1.0:1787782123.348283:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:1.0:1787782123.348294:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+23:14492:x1874625006000128:12345-192.168.202.56@tcp:58:dd.0 00010000:00010000:1.0:1787782123.348442:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.348465:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782123.348479:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782123.349655:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782123.349873:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787782123.349982:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787782123.350144:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+23:14492:x1874625006000128:12345-192.168.202.56@tcp:58:dd.0 Request processed in 1846us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782123.350158:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:1.0:1787782123.352481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782123.352718:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006000256 00000100:00100000:2.0:1787782123.352731:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006000256 00000100:00100000:2.0:1787782123.352841:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:2.0:1787782123.352853:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+23:14492:x1874625006000256:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:2.0:1787782123.352883:0:15085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782123.352911:0:15085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c904555d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140de07 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782123.353036:0:15085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782123.353049:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c904555d9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de07 expref: 24 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782123.353076:0:15085:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782123.353091:0:15085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c904555d9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de07 expref: 24 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782123.353106:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:2.0:1787782123.353109:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782123.353112:0:15085:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c904555d9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de07 expref: 24 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782123.353120:0:15085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9600, rc 0) 00000100:00100000:2.0:1787782123.353194:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+24:14492:x1874625006000256:12345-192.168.202.56@tcp:101:dd.0 Request processed in 344us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782123.353202:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00010000:00010000:1.0:1787782123.583078:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787782123.744469:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:1.0:1787782123.744494:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:1.0:1787782123.744511:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1787782123.744520:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:1.0:1787782124.031612:0:14413:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787782124.031701:0:14413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787782124.031888:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787782124.031899:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787782124.034026:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e5680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14413:1874625023808640:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787782124.034208:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782124.045071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782124.048474:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006000384 00000100:00100000:0.0:1787782124.048493:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006000384 00000100:00100000:0.0:1787782124.048572:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:0.0:1787782124.048582:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f79631f7-3d35-46c8-af7e-18b9151ff291+12:14493:x1874625006000384:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787782124.049189:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f79631f7-3d35-46c8-af7e-18b9151ff291+12:14493:x1874625006000384:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 Request processed in 604us (4140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782124.049200:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1787782124.049423:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e5680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14413:1874625023808640:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787782124.051351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.052480:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006000512 00000100:00100000:1.0:1787782124.052498:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006000512 00000100:00100000:1.0:1787782124.052602:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:1.0:1787782124.052629:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+11:14493:x1874625006000512:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787782124.052676:0:14377:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787782124.052886:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+11:14493:x1874625006000512:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 271us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782124.052918:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:3.0:1787782124.057166:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.057255:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006000640 00000100:00100000:2.0:1787782124.057337:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006000640 00000100:00100000:2.0:1787782124.057420:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:2.0:1787782124.057434:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+11:14493:x1874625006000640:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787782124.057553:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.057575:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.057590:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.060582:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.060609:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.060623:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.060658:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.060667:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.060674:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782124.060733:0:15085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787782124.060738:0:15085:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782124.060751:0:15085:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.060762:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061523:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061529:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061535:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782124.061539:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061547:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061560:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef45088a300) 00010000:00010000:2.0:1787782124.061563:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782124.061568:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061574:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c904555e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061591:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061597:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061603:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061607:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782124.061616:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061622:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061630:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ef45088a700) 00010000:00010000:2.0:1787782124.061633:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782124.061636:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061641:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c904555e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061656:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061662:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061667:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061671:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b9200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782124.061674:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061679:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061685:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:2.0:1787782124.061687:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782124.061696:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.061713:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c904555ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.062438:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+11:14493:x1874625006000640:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 5001us (5280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.062450:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:3.0:1787782124.070343:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.070456:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006000896 00000100:00100000:1.0:1787782124.070467:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006000896 00000100:00100000:1.0:1787782124.070580:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:1.0:1787782124.070591:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+11:14493:x1874625006000896:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782124.070612:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782124.070634:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c904555f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140de0e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.070773:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.070824:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.070838:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782124.070849:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787782124.071016:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.071024:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.071031:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.071037:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ec00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787782124.071042:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.071062:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.071075:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782124.071077:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787782124.071081:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.071087:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c904555fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.071131:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c904555f5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de0e expref: 13 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.071141:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ef45088a300) 00010000:00010000:1.0:1787782124.071143:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787782124.071147:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c904555f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de0e expref: 13 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.071156:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef48183f600, rc 0) 00000100:00100000:1.0:1787782124.071221:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+12:14493:x1874625006000896:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 632us (889us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787782124.071229:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:3.0:1787782124.077835:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.078345:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006001024 00000100:00100000:1.0:1787782124.078362:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006001024 00000100:00100000:1.0:1787782124.078428:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:1.0:1787782124.078438:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+12:14493:x1874625006001024:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787782124.078490:0:14379:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787782124.078637:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+12:14493:x1874625006001024:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 200us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782124.078646:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:3.0:1787782124.086914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.087091:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006001280 00000100:00100000:2.0:1787782124.087106:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006001280 00000100:00100000:2.0:1787782124.087189:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:2.0:1787782124.087201:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef473fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+12:14493:x1874625006001280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782124.087222:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782124.087243:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045560a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140de15 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787782124.088095:0:14378:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1787782124.088103:0:14378:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787782124.088152:0:14378:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787782124.088414:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455611 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.088429:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.088439:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.088500:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9200/0x3ad9816c9045560a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de15 expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.088523:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455611 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de15 expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.088531:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a700) 00010000:00010000:2.0:1787782124.088534:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782124.088538:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef4432b9a00, rc 0) 00000100:00100000:2.0:1787782124.088606:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef473fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+14:14493:x1874625006001280:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1408us (1707us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787782124.088614:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:3.0:1787782124.092278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.092413:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006001536 00000100:00100000:2.0:1787782124.092429:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006001536 00000100:00100000:2.0:1787782124.092502:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:2.0:1787782124.092519:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a715a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+14:14493:x1874625006001536:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787782124.092576:0:15085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782124.092602:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9a00/0x3ad9816c90455611 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de15 expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.092623:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a700) 00010000:00010000:2.0:1787782124.092633:0:15085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782124.092656:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.092669:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.092679:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.092709:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.092717:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.092725:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093030:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093039:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093046:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093052:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef4432b8600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782124.093056:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093064:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093073:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ef44a880c00) 00010000:00010000:2.0:1787782124.093076:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782124.093080:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093086:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b8600/0x3ad9816c9045561f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093103:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093109:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093115:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093121:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782124.093124:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093133:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093141:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x689b9f8e (ffff9ef45088a800) 00010000:00010000:2.0:1787782124.093144:0:15085:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782124.093148:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.093154:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414200/0x3ad9816c90455626 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x689b9f8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.093251:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a715a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+13:14493:x1874625006001536:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 740us (995us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787782124.093260:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:3.0:1787782124.100144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.100219:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006001664 00000100:00100000:2.0:1787782124.100235:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006001664 00000100:00100000:2.0:1787782124.100314:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:2.0:1787782124.100339:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+13:14493:x1874625006001664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782124.100360:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782124.100383:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415e00/0x3ad9816c9045562d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140de1c expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.100419:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414000/0x3ad9816c90455634 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.100431:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414000/0x3ad9816c90455634 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.100442:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414000/0x3ad9816c90455634 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.100625:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451415e00/0x3ad9816c9045562d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de1c expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.100644:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414000/0x3ad9816c90455634 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de1c expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.100652:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787782124.100656:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787782124.100660:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414000, rc 0) 00000100:00100000:2.0:1787782124.100738:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+14:14493:x1874625006001664:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 401us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.100746:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:3.0:1787782124.106318:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782124.107618:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006001920 00000100:00100000:0.0:1787782124.107636:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006001920 00000100:00100000:0.0:1787782124.107723:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:0.0:1787782124.107736:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+14:14493:x1874625006001920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787782124.108077:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.108101:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.108117:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787782124.112552:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787782124.112588:0:14379:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491890798455ns, next at 492890792192ns, rc = 0 00000004:00010000:0.0:1787782124.114249:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008acc700f reply state 0000000077b8c8bf transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782124.114518:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787782124.115067:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+16:14493:x1874625006001920:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 7319us (8748us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787782124.115078:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:1.0:1787782124.127545:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782124.127661:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006002048 00000100:00100000:0.0:1787782124.127675:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006002048 00000100:00100000:0.0:1787782124.127755:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:0.0:1787782124.127778:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+16:14493:x1874625006002048:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782124.127847:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782124.127884:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140de23 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.127978:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de23 expref: 17 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.127996:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de23 expref: 17 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.128018:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:0.0:1787782124.128022:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787782124.128026:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031c00, rc 0) 00000100:00100000:0.0:1787782124.128104:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+17:14493:x1874625006002048:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 339us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782124.128113:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00010000:00010000:2.0:1787782124.129188:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.129229:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.129237:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.129244:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782124.129249:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.129259:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.129545:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787782124.129549:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787782124.129556:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.129564:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c9045563b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.132334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782124.132585:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006002176 00000100:00100000:0.0:1787782124.132598:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006002176 00000100:00100000:0.0:1787782124.132853:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:0.0:1787782124.132866:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f5543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2352:x1874625006002176:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787782124.133515:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f5543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2352:x1874625006002176:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 649us (1195us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787782124.133527:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00080000:2.0:1787782124.135277:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782124.139865:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782124.140060:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006002432 00000100:00100000:3.0:1787782124.140072:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006002432 00000100:00100000:3.0:1787782124.140131:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1787782124.140140:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+16:14493:x1874625006002432:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787782124.140658:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+17:14493:x1874625006002432:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 515us (807us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787782124.140668:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1787782124.147935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.148441:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006002688 00000100:00100000:2.0:1787782124.148455:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006002688 00000100:00100000:2.0:1787782124.148547:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1787782124.148559:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+17:14493:x1874625006002688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787782124.148717:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+17:14493:x1874625006002688:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 160us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.148750:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1787782124.153951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782124.154080:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006002816 00000100:00100000:0.0:1787782124.154093:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006002816 00000100:00100000:0.0:1787782124.154170:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:0.0:1787782124.154181:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+17:14493:x1874625006002816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782124.154209:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782124.154236:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90455649 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140de2a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.154378:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90455650 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.154407:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90455650 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.154421:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90455650 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782124.154469:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782124.154492:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90455650 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.154524:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031e00/0x3ad9816c90455649 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de2a expref: 19 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.154560:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90455650 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de2a expref: 18 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.154571:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:0.0:1787782124.154575:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787782124.154579:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef440031400, rc 0) 00000100:00100000:0.0:1787782124.154672:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14493:x1874625006002816:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 492us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782124.154681:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:1.0:1787782124.159950:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.160378:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006002944 00000100:00100000:2.0:1787782124.160401:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006002944 00000100:00100000:2.0:1787782124.160476:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:2.0:1787782124.160489:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f3e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2351:x1874625006002944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782124.160515:0:15060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782124.160544:0:15060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140de31 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787782124.160582:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f63ed, blocks: 0x1 00010000:00010000:2.0:1787782124.160609:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787782124.160615:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782124.160628:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de31 expref: 7 pid: 15060 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.160652:0:15060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de31 expref: 7 pid: 15060 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.160669:0:15060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef451414200, rc 0) 00000100:00100000:2.0:1787782124.160756:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f3e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+7:2351:x1874625006002944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 269us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.160772:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:1.0:1787782124.165012:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.165352:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006003200 00000100:00100000:2.0:1787782124.165365:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006003200 00000100:00100000:2.0:1787782124.165531:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:2.0:1787782124.165544:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14493:x1874625006003200:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787782124.165701:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14493:x1874625006003200:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 160us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.165710:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:3.0:1787782124.174417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782124.174734:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006003328 00000100:00100000:0.0:1787782124.174746:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006003328 00000100:00100000:0.0:1787782124.174883:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:0.0:1787782124.174895:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14493:x1874625006003328:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787782124.233463:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1787782124.233481:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787782124.233657:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47695cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023808768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787782124.233754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782124.233881:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023808768 00000100:00100000:1.0:1787782124.233890:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023808768 00000100:00100000:1.0:1787782124.233970:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787782124.233980:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023808768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787782124.237383:0:15062:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787782124.237456:0:15062:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787782124.237459:0:15062:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787782124.237461:0:15062:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787782125 -> 1787782125 00002000:00010000:1.0:1787782124.237465:0:15062:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787782124.237583:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625023808768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3599us (3825us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787782124.237597:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787782124.237648:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782124.237853:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+17:14493:x1874625006003328:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 62958us (63450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782124.237879:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000004:00080000:0.0:1787782124.238344:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ef47695cf00/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787782124.238354:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47695cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023808768:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1787782124.238535:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1787782124.249117:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.250058:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006003456 00000100:00100000:1.0:1787782124.250073:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006003456 00000100:00100000:1.0:1787782124.250153:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1787782124.250170:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47695e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+7:2351:x1874625006003456:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787782124.250468:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47695e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+7:2351:x1874625006003456:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 303us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782124.250479:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1787782124.253042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.253256:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006003712 00000100:00100000:2.0:1787782124.253337:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006003712 00000100:00100000:2.0:1787782124.253481:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1787782124.253493:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+14:14493:x1874625006003712:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787782124.253566:0:15085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782124.253603:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031400/0x3ad9816c90455650 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de2a expref: 14 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.253626:0:15085:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787782124.253633:0:15085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782124.253673:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.253691:0:15085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.253704:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782124.254398:0:15085:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049979eda reply state 00000000ba985b5d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.254414:0:15085:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782124.254567:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+15:14493:x1874625006003712:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1074us (1537us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787782124.254576:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00010000:00010000:3.0:1787782124.260314:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.260337:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.260347:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.260354:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1787782124.260361:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.260371:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.260501:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:3.0:1787782124.260505:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782124.260512:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.260520:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef451414800/0x3ad9816c9045565e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15085 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.260698:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782124.260769:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006003840 00000100:00100000:3.0:1787782124.260825:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006003840 00000100:00100000:3.0:1787782124.260954:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1787782124.260966:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f555a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+7:14493:x1874625006003840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782124.260992:0:15060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782124.261015:0:15060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbd9b686140de38 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.261174:0:15060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de31 expref: 8 pid: 15060 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.261186:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787782124.261191:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782124.261196:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 8 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.261239:0:15060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de31 expref: 8 pid: 15060 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.261254:0:15060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de31 expref: 8 pid: 15060 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782124.261837:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15060:1874625023808896:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787782124.262109:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445391000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782124.265975:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.266123:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006003968 00000100:00100000:1.0:1787782124.266135:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006003968 00010000:00010000:1.0:1787782124.266193:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de31 expref: 9 pid: 15060 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.266247:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:1.0:1787782124.266258:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f5552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+9:2352:x1874625006003968:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782124.266278:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782124.266307:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de31 expref: 9 pid: 15060 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.266324:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de31 expref: 9 pid: 15060 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.266364:0:14363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782124.266458:0:14363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782124.266469:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 9 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.266483:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 9 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.266533:0:14363:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 9 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.266552:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47932c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14363:1874625023809024:192.168.202.56@tcp:105: 00000100:00100000:1.0:1787782124.266659:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801f00 going to sleep for 11 seconds 00010000:00010000:3.0:1787782124.267508:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053eb23ed/0x3ad9816c90455657 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de31 expref: 9 pid: 15060 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782124.267548:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15060:1874625023808896:192.168.202.56@tcp:104: 00010000:00010000:3.0:1787782124.267585:0:15060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 8 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.267599:0:15060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ef482045600, rc 0) 00000100:00100000:3.0:1787782124.267655:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f555a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+8:14493:x1874625006003840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 6690us (6964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782124.267666:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:1.0:1787782124.272270:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47932c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14363:1874625023809024:192.168.202.56@tcp:105: 00010000:00010000:1.0:1787782124.272309:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782124.272466:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f5552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+7:2352:x1874625006003968:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 6208us (6516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782124.272481:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:2.0:1787782124.273368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.273657:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006004096 00000100:00100000:1.0:1787782124.273668:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006004096 00000100:00100000:1.0:1787782124.273726:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1787782124.273735:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f557c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+7:2351:x1874625006004096:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787782124.274281:0:15061:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787782124.274287:0:15061:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787782124 00002000:00010000:1.0:1787782124.274290:0:15061:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787782123 00002000:00010000:1.0:1787782124.274292:0:15061:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787782125 -> 1787782124 00002000:00010000:1.0:1787782124.274295:0:15061:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787782124.276028:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f557c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+8:2351:x1874625006004096:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 650us (1023us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787782124.276050:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1787782124.281700:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782124.282143:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006004224 00000100:00100000:3.0:1787782124.282157:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006004224 00000100:00100000:3.0:1787782124.282221:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:3.0:1787782124.282232:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47932c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+8:2352:x1874625006004224:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787782124.282288:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.282315:0:15060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 8 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.282326:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782124.282332:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782124.282338:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.282401:0:15060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 8 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.282431:0:15060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 8 pid: 15060 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782124.282448:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15060:1874625023809152:192.168.202.56@tcp:104: 00000100:00100000:3.0:1787782124.282553:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef445391000 going to sleep for 11 seconds 00000100:00100000:3.0:1787782124.287009:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782124.287057:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006004352 00000100:00100000:3.0:1787782124.287068:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006004352 00010000:00010000:3.0:1787782124.287123:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 9 pid: 15060 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782124.287169:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:3.0:1787782124.287179:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+9:2351:x1874625006004352:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782124.287199:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782124.287231:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 9 pid: 15060 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.287248:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 9 pid: 15060 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.287282:0:14365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782124.287288:0:14365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782124.287295:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.287335:0:14365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.287365:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782124.287429:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f79631f7-3d35-46c8-af7e-18b9151ff291+9:2351:x1874625006004352:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 251us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782124.287438:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00010000:00010000:1.0:1787782124.287830:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091d60384/0x3ad9816c90455665 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de38 expref: 8 pid: 15060 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.287853:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a715e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15060:1874625023809152:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787782124.287894:0:15060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.287906:0:15060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.287913:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.287956:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.287973:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.287982:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.288006:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:1.0:1787782124.288011:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.288023:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.288039:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.288048:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c9045566c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.288118:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47932c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+7:2352:x1874625006004224:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 5887us (6431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782124.288127:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:3.0:1787782124.292556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.292668:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006004608 00000100:00100000:1.0:1787782124.292680:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006004608 00000100:00100000:1.0:1787782124.292775:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:1.0:1787782124.292807:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+14:14493:x1874625006004608:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787782124.292935:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.292959:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.292996:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.293313:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.293326:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de23 expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.293334:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.293376:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de23 expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.293394:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de23 expref: 15 pid: 14377 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.293409:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479334780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1874625023809280:192.168.202.56@tcp:104: 00000100:00100000:1.0:1787782124.293504:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef443801900 going to sleep for 11 seconds 00000100:00100000:3.0:1787782124.297273:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.297540:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006004736 00000100:00100000:2.0:1787782124.297552:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006004736 00010000:00010000:2.0:1787782124.297618:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de23 expref: 16 pid: 14377 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.297672:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:2.0:1787782124.297683:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a715680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+16:2351:x1874625006004736:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782124.297702:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782124.297719:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de23 expref: 16 pid: 14377 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.297735:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de23 expref: 16 pid: 14377 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.297777:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787782124.297783:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.297819:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.297828:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.298242:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782124.298325:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a715680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+16:2351:x1874625006004736:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 641us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.298335:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00010000:00010000:1.0:1787782124.299288:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef440031c00/0x3ad9816c90455642 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de23 expref: 15 pid: 14377 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.299312:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479334780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1874625023809280:192.168.202.56@tcp:104: 00010000:00010000:1.0:1787782124.299341:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.299352:0:14378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.299368:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787782124.299642:0:14378:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787782124.299833:0:14378:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787782124.300392:0:14378:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787782124.300517:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef479334780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14378:1874625023809408:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787782124.303313:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782124.303543:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023809408 00000100:00100000:0.0:1787782124.303554:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023809408 00000100:00100000:0.0:1787782124.303611:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782124.303623:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14378:x1874625023809408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787782124.303742:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14378:x1874625023809408:12345-0@lo:1000:mdt00_001.0 Request processed in 120us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782124.303752:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782124.304294:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef442d18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782124.304350:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef479334780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14378:1874625023809408:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787782124.305401:0:14378:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787782124.305516:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f557840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14378:1874625023809536:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787782124.305596:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782124.305639:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450f760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782124.305915:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023809536 00000100:00100000:0.0:1787782124.306645:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023809536 00000100:00100000:1.0:1787782124.307560:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782124.307577:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef47f555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14378:x1874625023809536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787782124.307897:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef47f555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14378:x1874625023809536:12345-0@lo:1000:mdt00_001.0 Request processed in 325us (2300us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787782124.307906:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782124.308022:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f557840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14378:1874625023809536:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787782124.308075:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308087:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308096:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308102:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183ec00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782124.308107:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308116:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308134:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:2.0:1787782124.308148:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782124.308155:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308162:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183ec00/0x3ad9816c9045567a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308198:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308205:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308211:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308216:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183fc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1787782124.308219:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308224:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308232:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:2.0:1787782124.308234:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782124.308242:0:14378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c904555d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de07 expref: 18 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308254:0:14378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c904555d9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de07 expref: 18 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308264:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c904555d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de07 expref: 18 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.308306:0:14378:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ef4432b9600/0x3ad9816c904555d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xcbd9b686140de07 expref: 18 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.308322:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f554000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1874625023809664:192.168.202.56@tcp:105: 00000100:00100000:2.0:1787782124.308401:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ef450f760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782124.311110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.311255:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f554000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1874625023809664:192.168.202.56@tcp:105: 00010000:00010000:1.0:1787782124.311295:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311309:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183fc00/0x3ad9816c904555d2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311358:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311376:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311389:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311422:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311429:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311435:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311441:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183e400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787782124.311445:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311453:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311467:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782124.311470:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782124.311474:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311480:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183e400/0x3ad9816c90455681 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311490:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311496:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311502:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311513:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef48183f600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1787782124.311517:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311523:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311532:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ef45088ac00) 00010000:00010000:1.0:1787782124.311534:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787782124.311537:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.311541:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef48183f600/0x3ad9816c90455673 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.311873:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14493:x1874625006004608:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 19085us (19329us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787782124.311889:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000020:00080000:1.0:1787782124.311899:0:14378:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787782124.312064:0:14413:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787782124.312073:0:14413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787782124.312108:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787782124.312115:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787782124.317478:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006004864 00000100:00100000:2.0:1787782124.317499:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006004864 00000100:00100000:2.0:1787782124.317596:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1787782124.317610:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef4450a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14492:x1874625006004864:12345-192.168.202.56@tcp:49:dd.0 00000100:00100000:2.0:1787782124.317839:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef4450a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14492:x1874625006004864:12345-192.168.202.56@tcp:49:dd.0 Request processed in 232us (6738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.317848:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1787782124.325684:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782124.325732:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006005120 00000100:00100000:3.0:1787782124.325744:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006005120 00000100:00100000:3.0:1787782124.325838:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:3.0:1787782124.325852:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+18:14493:x1874625006005120:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787782124.327363:0:14380:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787782124.327494:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787782124.327555:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.327576:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.327601:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.327612:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.327620:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.327626:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.327657:0:14380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787782124.327820:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a717c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+20:14493:x1874625006005120:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1942us (2123us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787782124.327833:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000020:00080000:3.0:1787782124.327841:0:14380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787782124.327968:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782124.327976:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.327985:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782124.327989:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.327999:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.328015:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ef45088a900) 00010000:00010000:3.0:1787782124.328019:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787782124.328032:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.328040:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ef482045800/0x3ad9816c90455688 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.328056:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782124.328058:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782124.328060:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787782124.330161:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000100:00100000:1.0:1787782124.421423:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782124.421556:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006005248 00000100:00100000:0.0:1787782124.421586:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006005248 00000100:00100000:0.0:1787782124.421715:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:0.0:1787782124.421729:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a763840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+6:2352:x1874625006005248:12345-192.168.202.56@tcp:4:dd.0 00002000:00010000:0.0:1787782124.421841:0:15066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8f63ec, atime: 0x6a8f63eb, ctime: 0x6a8f63ec, blocks: 0x1 00010000:00010000:0.0:1787782124.421853:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.421875:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1787782124.421880:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782124.421888:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.421905:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.428653:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1787782124.428766:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787782124.428780:0:15068:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787782124.429177:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006005376 00000100:00100000:0.0:1787782124.429190:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006005376 00000100:00100000:3.0:1787782124.430179:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:3.0:1787782124.430198:0:16611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a760b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+8:2352:x1874625006005376:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:3.0:1787782124.430249:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.430273:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782124.430278:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782124.430286:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.430302:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.437340:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.437514:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.437536:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.437551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1787782124.437959:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787782124.437974:0:15068:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787782124.438172:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006005504 00000100:00100000:2.0:1787782124.438185:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006005504 00000100:00100000:2.0:1787782124.438262:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787782124.438270:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006005632 00000100:00100000:2.0:1787782124.438273:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006005632 00000100:00100000:2.0:1787782124.438286:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787782124.438290:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006005760 00000100:00100000:2.0:1787782124.438292:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006005760 00000100:00100000:2.0:1787782124.438301:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787782124.438306:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006005888 00000100:00100000:2.0:1787782124.438308:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006005888 00000100:00100000:2.0:1787782124.439024:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1787782124.439041:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a762580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f79631f7-3d35-46c8-af7e-18b9151ff291+13:2352:x1874625006005504:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:2.0:1787782124.439102:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.439127:0:16612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782124.439132:0:16612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782124.439141:0:16612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.439156:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782124.447063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782124.447160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782124.447432:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787782124.447445:0:15067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1787782124.447592:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006006144 00000100:00100000:3.0:1787782124.448892:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006006144 00000100:00100000:3.0:1787782124.448985:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787782124.448995:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006006016 00000100:00100000:3.0:1787782124.449000:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006006016 00000100:00100000:3.0:1787782124.452669:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1787782124.452685:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a761a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f79631f7-3d35-46c8-af7e-18b9151ff291+16:2352:x1874625006005632:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:3.0:1787782124.452724:0:16613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.452741:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782124.452746:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782124.452752:0:16613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.452766:0:16613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787782124.537424:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1787782124.537446:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1787782124.537464:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1787782124.538570:0:15066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1787782124.538580:0:15066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787782124 -> 1787782125 00002000:00010000:2.0:1787782124.538584:0:15066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787782124 -> 1787782125 00002000:00010000:2.0:1787782124.538586:0:15066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1787782124.538606:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.538621:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.538630:0:15066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.538638:0:15066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031c00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787782124.538645:0:15066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.538677:0:15066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.538706:0:15066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.538714:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfdd21e4/0x3ad9816c9045568f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.538892:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a763840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+19:2352:x1874625006005248:12345-192.168.202.56@tcp:4:dd.0 Request processed in 117159us (117478us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787782124.538904:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1787782124.538962:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1787782124.538977:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+18:2352:x1874625006005760:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:2.0:1787782124.539019:0:15066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.539034:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782124.539040:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782124.539048:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.539061:0:15066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782124.608879:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787782124.614150:0:16612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1787782124.614165:0:16612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:2.0:1787782124.614184:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.614201:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.614210:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.614218:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415000 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787782124.614224:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.614234:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.614259:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.614267:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3eb4bb5/0x3ad9816c9045569d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.614378:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a762580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f79631f7-3d35-46c8-af7e-18b9151ff291+22:2352:x1874625006005504:12345-192.168.202.56@tcp:4:dd.0 Request processed in 175336us (177048us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787782124.614410:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1787782124.614452:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1787782124.614466:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f79631f7-3d35-46c8-af7e-18b9151ff291+21:2352:x1874625006005888:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:2.0:1787782124.614519:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.614534:0:16612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782124.614539:0:16612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782124.614546:0:16612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.614560:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.614649:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.614663:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.614671:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.614678:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045e00 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:3.0:1787782124.614681:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.614696:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.614711:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.614719:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c9f99c1/0x3ad9816c90455696 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782124.614774:0:16611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a760b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+21:2352:x1874625006005376:12345-192.168.202.56@tcp:4:dd.0 Request processed in 184581us (186137us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787782124.614783:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:3.0:1787782124.614842:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:3.0:1787782124.614851:0:16611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a763c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+20:2351:x1874625006006144:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:3.0:1787782124.614870:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.614880:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782124.614883:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782124.614887:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782124.614896:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787782124.615259:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1787782124.677409:0:16613:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:0.0:1787782124.677420:0:16613:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1787782124.677437:0:16613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.677450:0:16613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.677459:0:16613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.677480:0:16613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482045800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782124.677486:0:16613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.677496:0:16613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.677517:0:16613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.677527:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000680a7e3a/0x3ad9816c904556a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782124.677623:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a761a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f79631f7-3d35-46c8-af7e-18b9151ff291+20:2352:x1874625006005632:12345-192.168.202.56@tcp:4:dd.0 Request processed in 224938us (240105us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787782124.677634:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:0.0:1787782124.677666:0:16613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1787782124.677678:0:16613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f79631f7-3d35-46c8-af7e-18b9151ff291+19:2351:x1874625006006016:12345-192.168.202.56@tcp:4:dd.0 00010000:00010000:0.0:1787782124.677710:0:16613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.677722:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782124.677727:0:16613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782124.677733:0:16613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.677756:0:16613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787782124.678994:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:2.0:1787782124.679541:0:15066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.679557:0:15066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.679566:0:15066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.679574:0:15066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451415200 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787782124.679580:0:15066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.679601:0:15066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.679620:0:15066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.679627:0:15066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7a2c5f9/0x3ad9816c904556ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.679697:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+15:2352:x1874625006005760:12345-192.168.202.56@tcp:4:dd.0 Request processed in 140723us (242155us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787782124.679708:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000001:00080000:0.0:1787782124.725680:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1787782124.726352:0:16611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1787782124.726368:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726381:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726391:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726399:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef482044800 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787782124.726404:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726427:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726447:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726455:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3d2135c/0x3ad9816c904556b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.726550:0:16611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a763c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f79631f7-3d35-46c8-af7e-18b9151ff291+11:2351:x1874625006006144:12345-192.168.202.56@tcp:4:dd.0 Request processed in 111696us (279502us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787782124.726561:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00010000:00010000:2.0:1787782124.726607:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726616:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726623:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726628:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef451414600 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:2.0:1787782124.726632:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726651:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726662:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782124.726668:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000239709d2/0x3ad9816c904556b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782124.726699:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f79631f7-3d35-46c8-af7e-18b9151ff291+9:2352:x1874625006005888:12345-192.168.202.56@tcp:4:dd.0 Request processed in 112240us (289147us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787782124.726707:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:0.0:1787782124.734269:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782124.734292:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023809792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782124.734360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782124.734457:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023809792 00000100:00100000:2.0:1787782124.734465:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023809792 00000100:00100000:2.0:1787782124.734531:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787782124.734540:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023809792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787782124.734574:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782124.734619:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b41a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625023809792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.734625:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787782124.734675:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782124.734710:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874625023809792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782124.735346:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023810048:0@lo:400:kworker.0 00000100:00100000:2.0:1787782124.735385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782124.735409:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782124.735415:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3304:1874625023809920:0@lo:400:kworker.0 00000100:00100000:2.0:1787782124.735441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782124.735530:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023809920 00000100:00100000:0.0:1787782124.735536:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023809920 00000100:00100000:0.0:1787782124.735576:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787782124.735584:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3304:x1874625023809920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782124.735623:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd82860a-d07d-4a23-81c4-f74b9aa945b8+19:3304:x1874625023809920:12345-0@lo:400:kworker.0 Request processed in 40us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782124.735629:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787782124.735663:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd82860a-d07d-4a23-81c4-f74b9aa945b8:3304:1874625023809920:0@lo:400:kworker.0 00000100:00100000:0.0:1787782124.735680:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef473fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023810176:0@lo:400:kworker.0 00000100:00100000:0.0:1787782124.735702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782124.735718:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782124.735724:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef47f3e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023810304:0@lo:400:kworker.0 00000100:00100000:0.0:1787782124.735743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782124.735771:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023810048 00000100:00100000:0.0:1787782124.735776:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023810048 00000100:00100000:0.0:1787782124.735830:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023810176 00000100:00100000:0.0:1787782124.735834:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023810176 00000100:00100000:0.0:1787782124.735852:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023810304 00000100:00100000:0.0:1787782124.735854:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023810304 00000100:00100000:0.0:1787782124.735985:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787782124.735993:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef479334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023810048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782124.736028:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef479334780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625023810048:12345-0@lo:400:kworker.0 Request processed in 36us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.737423:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787782124.737447:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023810176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782124.737505:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625023810176:12345-0@lo:400:kworker.0 Request processed in 72us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.737511:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787782124.737527:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787782124.737533:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023810304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782124.737555:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b40780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625023810304:12345-0@lo:400:kworker.0 Request processed in 23us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782124.737560:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787782124.737658:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787782124.737684:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782124.737724:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625023810048:0@lo:400:kworker.0 00000100:00100000:3.0:1787782124.738569:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef47f3e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625023810304:0@lo:400:kworker.0 00000100:00100000:3.0:1787782124.738583:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef473fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625023810176:0@lo:400:kworker.0 00000001:00080000:1.0:1787782124.761989:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1787782124.764225:0:16613:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1787782124.764248:0:16613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.764258:0:16613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.764264:0:16613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.764269:0:16613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ef440031400 already unused, calling callback (ffffffffc16f5420) 00010000:00010000:0.0:1787782124.764272:0:16613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.764279:0:16613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.764314:0:16613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782124.764319:0:16613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044191006/0x3ad9816c904556c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782124.764418:0:16613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2351:x1874625006006016:12345-192.168.202.56@tcp:4:dd.0 Request processed in 86740us (317254us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787782124.764424:0:16613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1787782125.246572:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ef44a7143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023810432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782125.246646:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782125.248184:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625023810432 00000100:00100000:2.0:1787782125.248197:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625023810432 00000100:00100000:2.0:1787782125.248264:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787782125.248275:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023810432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787782125.248301:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:2.0:1787782125.248389:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef448b403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625023810432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782125.248396:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787782125.248542:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787782125.248549:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ef47695cf00, transno 8589934595 00000004:00080000:3.0:1787782125.248567:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1787782125.248597:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ef44a7143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874625023810432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782125.634418:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787782126.365133:0:16650:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1787782126.530399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782126.530438:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782126.530460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782126.530488:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782126.530507:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782126.530525:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1787782126.530547:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1787782126.532244:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006006656 00000100:00100000:1.0:1787782126.532258:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006006656 00000100:00100000:1.0:1787782126.532320:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006006912 00000100:00100000:1.0:1787782126.532323:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006006912 00000100:00100000:1.0:1787782126.532341:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006006528 00000100:00100000:1.0:1787782126.532343:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006006528 00000100:00100000:1.0:1787782126.532355:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006007040 00000100:00100000:1.0:1787782126.532358:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006007040 00000100:00100000:1.0:1787782126.532376:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:1.0:1787782126.532386:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a714b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2350:x1874625006006656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787782126.532463:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a714b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2350:x1874625006006656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782126.532471:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:1.0:1787782126.532488:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1787782126.532495:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2350:x1874625006006912:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787782126.532518:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2350:x1874625006006912:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782126.532524:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1787782126.532534:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1787782126.532540:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2350:x1874625006006528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787782126.532562:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a717840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f79631f7-3d35-46c8-af7e-18b9151ff291+5:2350:x1874625006006528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782126.532569:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1787782126.532579:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:1.0:1787782126.532586:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2350:x1874625006007040:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787782126.532621:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+5:2350:x1874625006007040:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782126.532627:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:1.0:1787782126.532649:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006006272 00000100:00100000:1.0:1787782126.532653:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006006272 00000100:00100000:1.0:1787782126.532679:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:1.0:1787782126.532685:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef478e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:2350:x1874625006006272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1787782126.532709:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef478e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03474bc7-848a-4d95-ae7f-d483d1ea7417+13:2350:x1874625006006272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782126.536222:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:2.0:1787782126.539264:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006006400 00000100:00100000:2.0:1787782126.539280:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006006400 00000100:00100000:2.0:1787782126.539346:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625006006784 00000100:00100000:2.0:1787782126.539349:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625006006784 00000100:00100000:2.0:1787782126.539381:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:2.0:1787782126.539391:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+20:2350:x1874625006006400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1787782126.539520:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:0.0:1787782126.539531:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2350:x1874625006006784:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:1.0:1787782126.539585:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787782126.539591:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782126.539593:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787782126.546863:0:15085:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787782126.546879:0:15085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787782126.548856:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f79631f7-3d35-46c8-af7e-18b9151ff291+20:2350:x1874625006006400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 9455us (18456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782126.548869:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:0.0:1787782126.549731:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ef44a7152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dcb5214e-4f9e-44fb-a0ba-a56fa13450fe+6:2350:x1874625006006784:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 10198us (19200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782126.549755:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00010000:00010000:1.0:1787782126.654000:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782127.681220:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782128.703056:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29066 lines, 29066 kept, 0 dropped, 0 bad.